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Preface 



This is the first report from the Next Generation project, an innovative collaboration 
among researchers at MDRC, several other leading research institutions, and the foundation 
funding partners that is aimed at understanding the effects of welfare and employment policies 
on low-income children and families. The collaborative and interdisciplinary nature of the pro- 
ject is reflected in the combination of authors of this document — Pamela Morris and Johannes 
Bos at MDRC, Aletha Huston and Danielle Crosby at the University of Texas at Austin, and 
Greg Duncan at Northwestern University — who together represent the fields of developmental 
psychology, economics, and policy analysis. 

The monograph provides the first comprehensive look at the findings from several recent 
evaluations of welfare and employment programs in order to examine the effects on children of 
three key policy approaches: providing financial supports to working families, requiring single 
parents to work, and limiting the length of time families can receive welfare. The studies on 
which this work is based were begun prior to the landmark federal welfare reforms of 1996, but 
many states have incorporated one or more of these policies into their post- 1996 programs. 

The most consistent finding is that programs that provided financial supports to parents 
who went to work — and increased parental employment and family income as a result — im- 
proved outcomes for children. Four of the 1 1 programs examined here offered such financial 
supports; in all four, elementary school-aged children’s school achievement was higher than that 
of children whose families were in the traditional welfare system. Thus, it appears that such pro- 
grams have the potential not only to support the working poor but also to complement education 
reforms aimed at improving the school achievement of low-income children. 

The document also provides some reassurance about the effects on children of requiring 
single parents to participate in work-related activities. The six programs examined here that in- 
creased parental employment through such mandatory employment services showed little evi- 
dence of negatively affecting elementary school-aged children, and they saved the government 
money. However, these programs also showed little evidence of benefiting these children. Re- 
garding older children, for whom outcomes were examined in two of the studies included here, 
the report sounds a note of caution: Both programs increased parental employment but had some 
negative effects on adolescents’ behavior and school achievement. 

Overall, the findings suggest that policymakers face a choice between offering mandatory 
employment services without financial work supports, which increase parental employment and 
reduce welfare dependence but have only neutral effects on children, and providing financial 
work supports, which increase parental employment, boost family income, and benefit children 
but also raise government expenditures. 

This monograph represents the kind of cross-cutting research synthesis — one directly 
relevant to policymakers — that is the mission of the Next Generation project. The project’s con- 
tinuing work will provide more detailed analyses of how job characteristics, child care policies, 
and family income affect low-income children. 



Judith M. Gueron 
President 
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Executive Summary 



Over the past 30 years, welfare and other public policies for families living in poverty 
have developed a primary objective of increasing parents’ self-sufficiency by requiring and sup- 
porting employment. The Personal Responsibility and Work Opportunity Reconciliation Act 
(PRWORA), passed in 1996, was a milestone in this effort, limiting the length of time that fami- 
lies can receive federal cash welfare assistance and requiring most of them to participate in em- 
ployment-related activities to be eligible for such assistance. In addition, during the 1990s the 
maximum benefits available to working-poor families through the Earned Income Credit (the 
federal tax credit that supplements the earnings of low-income families), publicly funded health 
insurance, and child care assistance were expanded to reward work outside the welfare system. 
Because many of these benefit expansions encourage parental employment, and because other 
changes have weakened the safety net for families in which parents do not maintain employment, 
all these developments may have important consequences for children. 

Proponents of changes in welfare policy have argued that parental employment benefits 
children by providing them with family role models who work and are self-sufficient and by in- 
troducing a regular schedule into the family routine. But employment may also create stress in 
the family, reduce parents’ opportunities to spend time with their children, and interfere with 
parents’ monitoring of their children’s activities — particularly in single-parent families. Chil- 
dren may also be influenced by parental employment through changes in family resources: If 
family income or subsidies supporting such work-related needs as child care increase, children 
may benefit; if family resources decrease, children may be harmed. The critical question for pol- 
icy is not “What are the effects of welfare reform on children?” Instead, it is “What program fea- 
tures are most likely to promote children’s well-being?” or, conversely, “What program features 
harm children or leave them unaffected?” 

In this monograph, we synthesize the results of five large-scale studies (see text box) that 
together examine the effects on children of 1 1 different employment-based welfare and antipov- 
erty programs aimed primarily at single-parent families. (A companion document' examines the 
effects of these and other programs on parental employment, welfare use, and income.) Specifi- 
cally, we attempt to identify the program features that are associated with effects on children’s 
school achievement, social behavior, and health. Although all the studies were under way by 
1996, they were designed to test the effects of many program features that have been imple- 
mented by the states since the federal welfare law of 1996 was passed. The monograph is a prod- 
uct of the Next Generation project, a collaboration among researchers at the Manpower Demon- 
stration Research Corporation (MDRC) and several leading research institutions that is being 
funded by the David and Lucile Packard Foundation, William T. Grant Foundation, and John D. 
and Catherine T. MacArthur Foundation. 

We classify the programs in these studies on the basis of three features that might have af- 
fected the experiences of children in the participating families: 



1 How Welfare and Work Policies Affect Employment and Income: A Synthesis of Research (MDRC). 2001. Dan 
Bloom and Charles Michalopoulos. 



Studies Examined in This Monograph 

The Next Generation project analyzes data from five program evaluations, building on their re- 
search designs, outcome measures, and impact analyses. The evaluations, and the organizations 
that conducted them, are listed below. 

Florida’s Family Transition Program was evaluated by MDRC under contract to the Florida De- 
partment of Children and Families. 

The Minnesota Family Investment Program was evaluated by MDRC under contract to the Min- 
nesota Department of Human Services. 

The National Evaluation ofWelfare-to-Work Strategies is being conducted by MDRC under con- 
tract to the U.S. Department of Health and Human Services. The Child Outcomes Study, which 
examines program impacts on young children, is being conducted by Child Trends under subcon- 
tract to MDRC. 

The New Hope program is being evaluated by MDRC under contract to the New Hope Project, 
Inc., in collaboration with researchers from Northwestern University, the University of Texas at 
Austin, the University of Michigan, and the University of California at Los Angeles. 

The Self-Sufficiency Project was conceived by Human Resources Development Canada. The pro- 
ject is being managed by the Social Research and Demonstration Corporation (SRDC) and evalu- 
ated by SRDC and MDRC. 



1 . Earnings supplements. Four of the programs offered generous earnings sup- 
plements designed to make work more financially rewarding by providing 
families with cash supplements or by increasing the amount of welfare that 
parents could keep when they went to work. (One of the programs also sup- 
plemented earnings less directly by subsidizing child care and health care 
beyond the levels provided in the community.) Earnings supplements are in- 
tended to increase family resources as well as to encourage parental employ- 
ment, and in the programs under study they generally succeeded in achieving 
both of these goals. While some of the programs with earnings supplements 
included other components as well, the provision of supplements was the only 
feature that the four programs in this category shared. 

2. Mandatory employment services. Six of the programs provided only manda- 
tory employment services — such as education, training, or immediate job 
search — in which parents were required to participate to be eligible to receive 
cash welfare benefits. Parents who failed to comply were subject to sanctions 
in the form of reduced welfare grants. The six programs in this category in- 
cluded mandatory employment services without any earnings supplements or 
time limits. In the programs under study, participation mandates (designed 
primarily to increase employment) were generally successful in raising em- 
ployment rates. When mandates were implemented without earnings supple- 
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ments, participants lost welfare benefits as they gained earnings, so these pro- 
grams did not usually raise family income or resources. 

3. Time limits. One of the programs under study put time limits on families’ eli- 
gibility for welfare benefits, restricting eligibility to a certain number of 
months in a specified period. This program was a pilot welfare reform initia- 
tive implemented prior to 1996 under waivers of federal welfare rules. Until 
1996, cash welfare assistance was a federal entitlement that was available as 
long as it was needed. The federal welfare law of 1996 sets a lifetime limit of 
five years on cash assistance receipt, but states may impose shorter limits or 
extend the time limits by using state funds. States may also exempt 20 percent 
of the caseload from the limits for hardship reasons. Once a family reaches the 
time limit, federally funded cash benefits are terminated, but the family nor- 
mally remains eligible for food stamps, Medicaid, low-income child care as- 
sistance, and (where available) state-supported cash assistance. The program 
with time limits combined them with mandatory employment services and a 
small earnings supplement; the result was an increase in parental employment 
but only a modest increase in family income. 

All the studies reviewed used a rigorous random assignment research design. Parents 
were placed at random in either a program group, which had access to the new services and bene- 
fits and was subject to the new rules, or a control group, which received the benefits and was 
subject to the rules that had previously existed in the locality of the study site or sites. In most 
cases, members of the control group were eligible for cash assistance through Aid to Families 
with Dependent Children (AFDC), the cash welfare program in effect prior to 1996. Because 
parents were assigned to the groups at random, the average characteristics of families in the pro- 
gram and control groups should not have differed systematically at the outset. The random as- 
signment method thus ensures that any differences between the two groups found during the 
study are due to the new program rather than to differences in the families’ initial characteristics 
or the general economic and social conditions that they experienced. 

In surveys conducted two to four years after parents entered the studies examined here, 
children’s school achievement, social behavior, and health were measured using parents’ reports 
and, in some studies, standardized tests or teachers’ reports. To ensure the comparability of re- 
sults, we focused on a subset of measures that were similar across studies yet represented a wide 
range of outcomes for children that might be affected by welfare and work policies. Using these 
measures, we conducted analyses for subsamples composed of single parents — the great major- 
ity of whom were women — with children who ranged in age from approximately 3 to 9 when 
their parents entered the study. At the time at which school achievement, behavior, and health 
were measured, the children’s approximate age range was 5 to 12. The findings for all the meas- 
ures of children’s well-being and for the full samples can be found in the reports from the indi- 
vidual studies. 2 



2 The Family Transition Program: Final Report on Florida ’s Initial Time-Limited Welfare Program (MDRC). 
2000. Dan Bloom, James Kemple, Pamela Morris, Susan Scrivener, Nandita Verma, Richard Hendra. 

Impacts on Young Children and Their Families Two Years After Enrollment: Findings from the Child Outcomes 
Study (U.S. Department of Health and Human Services, Office of the Assistant Secretary for Planning and Evalua- 
tion and Administration for Children and Families; and U.S. Department of Education, Office of the Under Secretary 
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The difference between the children in the program group families and those in the con- 
trol group families on a given outcome is referred to as the program’s impact on that outcome. 
For each of the programs, we computed impacts and tested whether the impacts were statistically 
significant (that is, unlikely to have occurred by chance). We also examined the patterns of im- 
pacts for the programs that shared each of the three features introduced above. “Increases” and 
“decreases” refer to the differences that emerged over time between the program and control 
groups. Our main findings follow. 

• The programs that included earnings supplements, all of which increased 
both parental employment and income, had positive effects on elementary 
school-aged children. All four programs that provided earnings supplements 
led to higher school achievement. Some of the programs also reduced behav- 
ior problems, increased positive social behavior, and/or improved children’s 
overall health. 

• Adding mandatory employment services did not generally reduce the 
positive effects of earnings supplements on children. The only program that 
included mandatory employment services in addition to an earnings supple- 
ment increased parents’ full-time employment but generally did not affect 
children’s outcomes beyond having the same positive effects as the program 
did when it was implemented with earnings supplements alone. 

• The programs with mandatory employment services, all of which boosted 
parental employment without increasing income, had few effects on chil- 
dren, and the effects were mixed in direction. These six programs had rela- 
tively few noteworthy effects on children. When impacts were found, the ef- 
fects were about equally likely to be positive as negative. The pattern of im- 
pacts appeared to be more closely associated with particular sites than with 
program characteristics like participation mandates. 

• The program with time limits, which led to an increase in parental em- 
ployment and a modest increase in income, produced few noteworthy im- 
pacts on children, and the impacts found did not suggest a consistent pat- 
tern of benefit or harm. Our knowledge base is smallest with regard to the 
impacts of time limits because only one program had time limits, and this pro- 
gram combined them with mandatory employment services and a small earn- 
ings supplement. The program’s few impacts on children were mixed: Health 
improved, but positive social behavior decreased. 

These general conclusions are subject to the following caveats: 



and Office of Vocational and Adult Education). National Evaluation of Welfare-to-Work Strategies. 2000. Sharon 
McGroder, Martha Zaslow, Kristin Moore, Suzanne LeMenestrel. 

New Hope for People with Low Incomes: Two-Year Results of a Program to Reduce Poverty and Reform Wel- 
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• Although the effects of earnings supplements on children are encourag- 
ing, the improvements are modest when considered in the context of these 
children’s high levels of disadvantage. Even the programs with the most 
benefits to children left many families in poverty and many children at risk of 
school failure and behavior problems. These programs do not eliminate the 
need for child-focused interventions and reforms that promote school 
achievement and reduce behavior problems. 

• The positive effects of earnings supplement programs on children were 
most pronounced for the children of long-term welfare recipients. For 

families in which the parent had a long history of using welfare, the programs 
with earnings supplements improved children’s development and increased 
parental employment and family income. 

• The conclusions in this monograph are limited to preschool-aged and 
elementary school-aged children. Infants and toddlers, as well as adoles- 
cents, may be affected differently by the welfare reform approaches ex- 
amined here. Too few of the studies considered here specifically examined 
children under age 3 for general conclusions to be drawn. For adolescents, 
however, two of the studies (one examining a program with an earnings sup- 
plement and another a program with a time limit) found decreases in school 
achievement and increases in behavior problems among adolescents. 

• Although the program features examined in this monograph are similar 
to those included in many programs that have been implemented by 
states since 1996 , they do not represent the full range of earnings supple- 
ments, participation mandates, and time limits currently in effect. The 
patterns from which these broad conclusions are drawn were observed in pro- 
grams in different geographic regions with different population characteristics, 
justifying some confidence that the findings will generalize across different 
contexts. Nonetheless, most of the studies were conducted prior to the passage 
of the 1996 federal welfare legislation, and their impacts could be different in 
a different macroeconomic or policy context. Moreover, while the policies 
examined here are representative of some of the state policies currently in 
effect, policies that provide less generous supplements or impose more 
stringent mandates or time limits than those examined here may have different 
effects on children. 

The welfare reforms initiated by the states and the legislated changes in the 1990s did not 
lead to one new welfare policy but to a variety of policies that continue to evolve. As welfare 
caseloads decline, federal and state policies are generally being expanded to reach all working- 
poor families, regardless of their welfare status. The findings of this synthesis may guide policy 
choices that promote the development of children both in families receiving welfare and in other 
low-income families. Welfare reforms and antipoverty programs can have a positive impact on 
children’s development if they increase employment and income, but increasing employment 
alone does not appear sufficient to foster the healthy development of children. Children living in 
poverty are at risk of low achievement, behavior problems, and health problems, so it is critical 
that policies affecting their families enhance children’s well-being rather than leaving them at the 
same level of deprivation and risk that they experienced under the former welfare system. We 
hope that this analysis will help state and federal policymakers make informed choices that keep 
the effects on children in focus as they design legislation that affects low-income parents. 



Chapter 1 

Introduction 



The Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA), 
passed in 1996, was the culmination of several decades of efforts to promote work and reduce 
long-term welfare receipt among single-parent families, the great majority of which are headed 
by women. As a result of these efforts, the welfare system was not only transformed, but benefits 
for working-poor families were expanded to reward work outside the welfare system through the 
Earned Income Credit (EIC, the federal tax credit that supplements the earnings of low-income 
families), publicly funded health insurance, and child care assistance. Whether promoting work 
among low-income single parents helps or hurts children, and under what conditions, is the sub- 
ject of this monograph. The monograph is a product of the Next Generation project, a collabora- 
tion among researchers at the Manpower Demonstration Research Corporation (MDRC) and sev- 
eral leading research institutions that is being funded by the David and Lucile Packard Founda- 
tion, William T. Grant Foundation, and John D. and Catherine T. MacArthur Foundation. 

Proponents of the policy changes have argued that parental employment benefits children 
by increasing parents’ self-esteem and providing children with positive role models. Skeptics 
worry that greater work responsibilities may harm children by increasing parents’ stress, reducing 
the amount of time parents can spend with their children and monitoring them, and increasing the 
amount of time children spend in low-quality child care arrangements. For parents unable to 
maintain consistent employment, skeptics also worry that the loss of a financial safety net may 
adversely affect children. In the context of increasing autonomy at the state level and the poten- 
tial for welfare policy to evolve further at the federal level, understanding how children are af- 
fected by different welfare policies is critical. This monograph seeks to advance our understand- 
ing of how various welfare reform programs affect children by synthesizing evidence from 
evaluations of 11 welfare and employment programs. A companion document' examines the ef- 
fects of these and other programs on parental employment, welfare use, and income. The five 
large-scale evaluations covered here are unusual in their experimental rigor and comprehensive 
measurement of children’s well-being. 

The relevant policy background and an overview of this research synthesis are provided 
in this chapter. In Chapters 2, 3, and 4, we analyze the effects on children’s well-being of pro- 
grams with earnings supplements, mandatory employment services, and time limits, respectively. 
In those three chapters, we discuss how parenting, child care, and other family changes may ac- 
count for the programs’ effects on children. We also examine effects on the children of long-term 
welfare recipients, on preschool-aged versus early school-aged children, and on boys versus girls. 
Based on the results of the two studies that have examined adolescents, in Chapter 5 we explore 
the possibility that the programs affect adolescents differently than children in other age groups. 
Chapter 6 presents an overall summary of the research synthesis laid out in the preceding chap- 
ters and discusses its implications for policy. 



‘Bloom and Michalopoulos, 200 1 . 
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I. 



Historical Background: Welfare Reform and Children 



The 1996 federal welfare reform law introduced sweeping changes to the nation’s system 
for supporting low-income families with children. During the prior six decades, Aid to Families 
with Dependent Children (AFDC) had guaranteed aid for economically deprived families with 
children. The new law eliminated AFDC, which was funded as an open-ended entitlement, and 
replaced it with Temporary Assistance for Needy Families (TANF), which provided block grants 
to states, introduced time limits on cash assistance, and imposed work requirements on recipi- 
ents. The law made other substantial changes affecting child care, the Food Stamp Program, 
Supplemental Security Income (SSI) for children, and the Child Support Enforcement program, 
giving states numerous options — for instance, the option to require work of parents with infants 
(children under 12 months old), to cap benefits so that payments do not increase if recipients 
have additional children (“family caps”), and to require individuals to sign individual responsibil- 
ity plans. The most controversial of these changes was the institution of time limits on receipt of 
federal cash assistance. One of the studies examined in this monograph provides information 
about the effects of a time-limited welfare reform program on children. 

These sweeping changes were the results of a more gradual process, begun in the 1960s, 
intended to push welfare recipients toward higher levels of employment-based self-support. In 
1967, Congress passed a law requiring parents who were receiving AFDC and who had no pre- 
school-aged children to register for work activities. Efforts to enforce work requirements varied 
widely from one state to the next and were not taken seriously by most states until the early 
1980s. Changes in 1981 and in 1988 (following passage of the Family Support Act) sought to 
accelerate states’ efforts to promote employment and reduce welfare, but full implementation 
was thwarted by the recession of the early 1990s. Efforts to understand the impact of these policy 
changes (such as mandatory employment services) on children’s development gave rise to some 
of the evaluations included in this monograph. 

In the four years prior to the 1996 legislation, the federal government granted waivers of 
federal AFDC rules to more than 40 states to allow them to experiment with program changes. 
The evaluations conducted under such waivers in Minnesota and Florida provide some of the 
data used here. Waiver provisions varied widely among states. Some included earnings supple- 
ments designed to compensate recipients for lost welfare benefits as their earnings increased and 
thereby to encourage them to increase their work effort. Without supplements, welfare recipients 
typically lost their benefits at about the same rate as they gained earnings, so their income did not 
increase with their work effort. Many programs tested requirements that recipients participate in 
employment-related activities or risk losing their benefits. Others tested time limits on welfare 
receipt. Programs that included earnings supplements, mandatory employment services, and time 
limits were tested in the studies examined here. 

II. Program Features 

The debate surrounding the passage of the 1996 welfare reform legislation has been 
fraught with assumptions and predictions about the effects of the proposed reforms on children. 
Reform advocates foresaw many benefits to children of increased parental employment, which 
they believed would create positive role models, promote parents’ self-esteem and sense of con- 
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trol, introduce productive daily routines into family life, and eventually foster career advance- 
ment and higher earnings on the part of both parents and children. 2 In this view, children’s devel- 
opmental needs are addressed indirectly but effectively by policies that promote employment 
among welfare recipients. 

A very different view of the potential effects of welfare reforms on children stresses the 
role of family income and resources available to children. Armed with forecasts of dramatic in- 
creases in child poverty, critics of welfare reform focused on the likely detrimental effects on 
children’s well-being of families’ losing welfare benefits. Proponents were more optimistic that 
as parents moved into jobs, their future earnings would elevate family income above the level of 
welfare benefits. 

Welfare reform was also intended to encourage marriage and discourage out-of-wedlock 
childbearing, both of which were expected to improve children’s well-being. The preamble to the 
1996 PRWORA legislation identifies marriage as “an essential institution of a successful society 
which promotes the interests of children,” posits that “responsible fatherhood and motherhood 
are integral to successful child rearing and the well-being of children,” and asserts that the “pre- 
vention of out-of-wedlock pregnancy and reduction in out-of-wedlock births are very important 
Government interests.” Limiting cash support for single parents and instituting caps on assistance 
for women who have additional children while on welfare were aimed at discouraging out-of- 
wedlock childbearing. But these policies — which were designed to affect marriage, paternal in- 
volvement, and family structure directly — are not represented in enough studies to allow sys- 
tematic comparison of them. 

In this monograph, we draw on studies of programs that were designed primarily to affect 
parental employment and income but that could have affected children indirectly. Specifically, we 
examine the effects on children of programs that include three policy approaches currently used in 
many state welfare programs: earnings supplements, mandatory employment services, and time 
limits on welfare receipt. Each of these program features is designed to encourage work, reduce 
welfare use, and — particularly in the case of earnings supplements — increase income. 

A. Earnings Supplements 

Some welfare and antipoverty programs include strategies specifically designed to make 
work more financially rewarding than welfare. The labor market accessible to the working poor of- 
fers mainly low-skill, low-pay jobs that are often transitory, making welfare potentially more attrac- 
tive than work. Some welfare reform programs try to compensate for some of the shortcomings of 
the labor market by “making work pay” — that is, by providing extra income and resources to re- 
cipients who are employed. Some such programs require full-time employment; others provide 
earnings supplements for any amount of work. Supplements are sometimes provided within the 
welfare system by increasing the earnings disregard (the amount of earnings that is not counted as 
income in calculating the amount of a family’s welfare benefit) so that families can keep more of 
their welfare dollars when parents go to work. In other programs, earnings supplements are pro- 
vided outside the welfare system in the form of cash supplements and — sometimes in addition — 



2 Haskins, forthcoming, 2001. 
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in-kind benefits such as child care or health care subsidies. Most states have already made enhanced 
earnings disregards a key component of their TANF policies. A few other states provide cash sup- 
plements through refundable tax credits. The studies examined in this monograph include policies 
that are comparable to the most generous disregards provided in many current state programs. 

B. Mandatory Employment Services 

Since the 1970s, welfare reform approaches have been designed to induce participation in 
work-related activities or employment by making participation mandatory. The primary tool used 
to enforce participation mandates is sanctioning, whereby a recipient’s welfare grant is reduced if 
she or he does not comply with program requirements. These programs are designed to reduce 
welfare use and increase employment either by promoting parents’ participation in job search and 
job training or by requiring parents’ participation in basic education, both with the long-term goal 
of increasing the employability of these often low-skilled workers. Today, virtually all states are 
using such mandates in their attempt to reduce welfare use and increase parents’ self-sufficiency. 
In some cases, the mandates are more stringent (with respect to the number of hours of work re- 
quired or the size of the sanction) than those in the studies examined here. 

C. Time Limits 

Until 1996, cash welfare assistance was a federal entitlement that was available to fami- 
lies as long as they met the eligibility requirements. The federal welfare law of 1996 sets a life- 
time limit 3 of five years on cash assistance receipt, but states may shorten or extend the limits by 
using state funds. States may also exempt 20 percent of the caseload from time limits for hard- 
ship reasons. Once a family reaches the time limit, federally funded cash benefits are terminated, 
but the family normally remains eligible for Food Stamps, Medicaid, low-income child care as- 
sistance, and (where available) state-supported cash assistance. Time limits are intended to re- 
duce welfare dependence, encouraging parents to work in order to support their families. More 
than 40 states have established limits on the receipt of cash assistance, ranging from 21 to 60 
months. 

III. The Relation Between Program Features and Children’s Outcomes 

To further our understanding of how policy features such as earnings supplements, man- 
datory employment services, and time limits affect children, we draw on extensive research on 
the link between parental employment, welfare dependence, and income on the one hand and 
children’s outcomes on the other. The resulting conceptual model is presented in Figure 1.1. A 
central idea behind this model is that policy changes can affect children indirectly through 
changes in resources (for instance, child care, housing, learning materials, and food) and through 
changes in children’s socialization experiences (their family functioning and relationships with 
parents). Examining such intermediate outcomes, or possible mediators of programs’ effects on 
children, helps us understand not only whether a policy affects children but also how it does so. 



lifetime limits restrict the number of months in the recipient’s lifetime that she or he can receive welfare bene- 
fits. Fixed-period time limits, in contrast, restrict the number of months of benefits over a shorter, specified period — 
for example, to 24 months in any 60-month period. The time-limited program examined in this monograph includes a 
fixed-period limit rather than a lifetime limit. 
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How Welfare and Work Policies Affect Children 



Figure 1.1 

Mechanisms Through Which Welfare and Employment Policies Might Affect Children 
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Below we review the literature on the relations between the primary targets of these interventions 
(parental employment, income, and welfare use) and children’s development, paying particular 
attention to the possible dependency of these effects on the age and gender of the child. 

A. Effects of Maternal Employment 

The effects of maternal 4 employment on children depend on the characteristics of the 
mother’s job, the extent to which family resources increase, the mother’s psychological well- 
being, and the quality of the child care, youth programs, and neighborhood to which the child is 
exposed. For low-income families headed by single mothers, in particular, the associations be- 
tween maternal employment and children’s cognitive and social development tend to be posi- 
tive. 5 But it appears that much, if not all, of this difference stems from differences between em- 
ployed and unemployed mothers in their demographic attributes, skills, personalities, and child- 
rearing practices rather than from their employment status per se. 6 Moreover, holding highly 
routinized jobs that pay very low wages and afford little autonomy appears to have negative ef- 
fects on mothers’ emotional well-being and, in turn, on children’s development. 7 Unpredictable 
and unconventional work hours, which are characteristic of many low-wage jobs, may make it 
difficult for parents to combine work and family responsibilities.. Maternal employment may have 
more positive effects on children when mothers believe their children will not suffer as a result 
than when it conflicts with their beliefs about what is best for their families. 8 

B. Effects of Family Income 

In studies conducted in the United States, poverty has been found to have small but consis- 
tently negative effects on children’s development. 9 Unsurprisingly, persistent and deep poverty has 
been shown to be more detrimental to children than transient poverty. 10 Family income may influence 
children through both the resource and socialization pathways in Figure 1.1 — affecting the resources 
parents can provide to their children and influencing parental stress and parenting behavior." In the 
few longitudinal studies that have been conducted, family income consistently predicts children’s aca- 
demic and cognitive performance, even when other family characteristics are taken into account. 12 
Children from low-income families also have more behavior and health problems than those from 
more affluent families do. 13 Family characteristics associated with poverty account for these 
differences in some studies. 14 



4 Because the vast majority of the single parents in the studies included in this monograph were mothers, here we 
review research that focuses specifically on the effects of maternal employment on children. 

5 Harvey, 1999; Vandell and Ramanan, 1992; Zaslow and Emig, 1997. 

6 Zaslow, McGroder, Cave, and Mariner, 1999. 

7 Moore and Driscoll, 1997; Parcel and Meneghan, 1994, 1997. 

8 Jackson, 1993; NICHD Early Child Care Research Network, 1998a. 

9 Duncan, Brooks-Gunn, and Klebanov, 1994; Duncan and Brooks-Gunn, 1997; Mayer, 1997; McLoyd, 1998. 
l0 Duncan et al., 1994; Bolger, Patterson, Thompson, and Kupersmidt, 1995. 

"Bradley and Caldwell, 1984; Smith, Brooks-Gunn, and Klebanov, 1997; Sugland, Zaslow, Smith, Brooks- 
Gunn, Moore, Blumenthal, Griffin, and Bradley, 1995; McLoyd, Jayartne, Ceballo, and Borquez, 1994. 
l2 Duncan and Brooks-Gunn, 1997. 

l3 Duncan and Brooks-Gunn, 1997; Klerman, 1991; Korenman and Miller, 1997. 
l4 Duncan and Brooks-Gunn, 1997. 
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C. Effects of Welfare Receipt 



Some have argued that income from welfare is less beneficial to children than other 
forms of family income because it carries a stigma. The research evidence does not consis- 
tently support or refute this hypothesis. Many studies found no relation between welfare re- 
ceipt and children’s cognitive and social development once demographic and family character- 
istics are taken into account; in rare cases, positive relations were found . 15 Other studies re- 
vealed that children in families receiving welfare have lower-quality home environments , 16 
lower academic achievement , 17 and lower completed schooling 18 than children in other poor 
families. It is possible, however, that people receiving welfare have fewer material resources 
and assets than do other low-income families, which might explain these differences. More- 
over, entry into and out of welfare programs is often associated with other transitions and 
changes (such as job loss or entry, parents’ separating or acquiring new partners, and changes 
in child care arrangements) that affect parents’ and children’s well-being. Several studies ob- 
served higher levels of behavior problems (as reported by mothers) among children whose 
families had recently made a transition into welfare 19 and among children whose families had 
recently left welfare 20 than among children whose families had not recently changed status. 

D. Differences by Aee 

Maternal employment and family income may have more profound effects on young 
children than on children who have reached school age. Developmental theories suggest that 
infants and preschool-aged children are more sensitive than older children to separation from 
their parents. In addition, one study indicates that poverty during the preschool years predicts 
cognitive development and educational attainment better than does poverty during middle 
childhood or adolescence . 21 

The available data suggest that the effects of maternal employment on young children’s 
cognitive and language skills depend on the quality of the child care provided while the mother 
is working, which may in turn be influenced by family income. The cognitive and language 
skill development of children in low-income families benefits from high-quality care as com- 
pared with low-quality care . 22 In addition, formal, center-based child care is more beneficial to 
cognitive development than home-based care when the two are of comparable quality . 23 



15 Butler, 1990; Haveman and Wolfe, 1995; Levine and Zimmerman, 2000; Ratcliffe, 1996; Yoshikawa, 1999; 
Zill, Moore, Smith, Stief, and Coiro, 1995. 

l6 Moore, Morrison, Zaslow, and Glei, 1994; Smith and Brooks-Gunn, 1994. 
l7 Smith and Brooks-Gunn, 1994; Hofferth, Smith, McLoyd, and Finkelstein, 2000. 
l8 Duncan and Yeung, 1995. 

19 Smith and Brooks-Gunn, 1994; Moore et al., 1994. 

20 Hofferth et al., 2000. 

2l Duncan and Brooks-Gunn, 1997. 

22 Burchinal, Roberts, Riggins, Zeisel, Neebe, and Bryant, 2000; NICHD Early Child Care Research Network, 
2000; Peisner-Feinberg, Burchinal, Clifford, Culkin, Howes, Kagan, Yazsjian, Byler, Rustici, and Zelazo, 1999; 
Ramey, Campbell, Burchinal, Skinner, Gardner, and Ramey, 2000; Shonkoff and Phillips, 2000. 

23 NICHD Early Child Care Research Network, 2000. 
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The effects of nonmatemal child care on health and social behavior are more mixed than 
those on cognitive development. Infants who are placed in group child care arrangements have 
higher rates of contagious illnesses than do infants who are cared for at home, although the dif- 
ference declines by age 3. 24 The effects of child care (whether of high or low quality) on chil- 
dren’s social behavior, however, are much less consistently positive or negative. 25 

Once children begin school, the quality of child care may play a less critical role in the 
acquisition of academic skills because children are receiving instruction in school. At this stage, 
the quality of out-of-school activities and community supports becomes an important influence 
on the development of positive behavior and behavior problems. 26 Adolescents may be more 
cognizant than younger children of the characteristics and value of their parents’ work away from 
home; hence, they may benefit more from the positive role modeling of maternal employment. 
Moreover, older children may simply need less time with their parents than do their younger 
peers. On the other hand, employment may make it more difficult to monitor older children’s ac- 
tivities, especially as they become independent of adult supervision in adolescence. There is 
some evidence that for adolescent children maternal employment, in conjunction with low levels 
of monitoring and communication, is related to delinquency, 27 low educational attainment, 28 and 
low well-being. 29 

E. Differences by Gender 

Theory and research in developmental psychology suggest that maternal employment af- 
fects girls and boys differently. The extensive literature on how parental employment affects 
children is guided by the theory that children use their same-sex parent as a model of their own 
future employment possibilities. 30 Because most participants in welfare programs are mothers, 
changes in maternal employment could have more positive modeling effects for daughters than 
for sons. On the other hand, one consequence of increased maternal employment may be that 
girls are asked to perform more housekeeping and child care tasks, especially in low-income 
families that cannot afford paid help. A moderate number of such tasks may promote girls’ de- 
velopment, but extensive adult responsibilities may interfere with their school achievement and 
lead to other problems. 

A wide range of evidence indicates that boys are more vulnerable to problems in school, 
behavior problems, and poor health than are girls. 31 Hence, boys may show more negative effects 
of parental employment than girls, particularly if their parents are in programs that increase stress 
or reduce monitoring. But because many parents are aware of boys’ greater likelihood of being 
aggressive and disobedient, they may exert more energy and expend more resources on prevent- 




24 NICHD Early Child Care Research Network, forthcoming, 2001. 

25 NICHD Early Child Care Research Network, 1998b; Peisner-Feinberg et al., 1999. 

26 Marshall, Garcia, Marx, McCartney, Keefe, and Ruh, 1997; Pettit, Laird, Bates, and Dodge, 1997; Pettit, 
Bates, Dodge, and Meece, 1999. 

27 Sampson and Laub, 1994. 

28 Duncan and Yeung, 1995. 

29 Crouter, Bumpass, and McHale, 1999. 

30 Huston, 1983. 

3l Golombok and Fivush, 1994. 
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ing behavior problems in their sons than in their daughters. For example, ethnographic observa- 
tions of families in the New Hope program in Milwaukee, Wisconsin, suggest that parents may 
have invested their increased income in funding their sons’ (as opposed to daughters’) after- 
school activities and meeting their sons’ needs because they worried about boys’ behavior prob- 
lems increasing. 32 

IV. Examining Children in Random Assignment Studies 

In each of the studies examined in this monograph, families were assigned at random 
(through a lottery-like process) to either a program group or a control group. The program group 
was subject to the rules and benefits of the new program, while the control group was subject to 
the prior program (usually the AFDC program in operation during or prior to that period). Be- 
cause the two groups did not differ systematically at the beginning of the study, any differences 
between them found during the study can be reliably attributed to differences between the 
groups’ experiences in their respective programs. 

Examining programs’ effects on children in the context of a random assignment study of- 
fers several advantages over the research just reviewed on the effects of employment, welfare 
receipt, and income on children. First, poor families probably differ from nonpoor families and 
working families from nonworking families on dimensions other than income and employment 
status. For example, low-income mothers may be more depressed on average than mothers with 
higher incomes. Therefore, the fact that children in higher-income families perform better in 
school could be explained either by their parents’ higher incomes or by their parents’ lower levels 
of depression. Unfortunately, in the research reviewed above, it is very difficult to disentangle the 
positive effects of employment and income from such unmeasured differences between families. 
In the studies examined in this monograph, in contrast, the random assignment design ensures 
that any systematic differences in children’s outcomes can be confidently attributed to the pro- 
gram and not to unmeasured characteristics. The studies described above also do not examine the 
effects on children of changes in parental employment, welfare receipt, and income over time but 
instead compare children in families with different a priori levels of employment, welfare receipt, 
and income. As a result, even if the differences between poor and nonpoor children were due to 
poverty, on the basis of these studies we cannot know if increasing family income improves the 
lives of children in poor families to the same degree as in nonpoor families. Because the pro- 
grams examined here were targeted at employment, welfare receipt, and income, any differences 
in children’s outcomes between the program and the control groups are likely to be related to the 
changes in these economic outcomes for parents. 

V. The Studies 

This monograph presents results for children whose parents participated in the five stud- 
ies described in Box 1.1, in which a total of 1 1 welfare and employment programs were evalu- 
ated. Each program included a variety of features. We classify the programs on the basis of the 
three features already discussed: earnings supplements, mandatory employment services, and 



32 Bos, Huston, Granger, Duncan, Brock, and McLoyd, 1999. 
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time limits. By looking across programs that differed with respect to these features, we can make 
inferences about the effects of particular policy approaches on children. 



How Welfare and Work Policies Affect Children 
Box 1.1 

Studies Examined in This Monograph 

The Next Generation project analyzes data from five program evaluations, building on their re- 
search designs, outcome measures, and impact analyses. The evaluations and the organizations 
that conducted them are listed below. 

Florida’s Family Transition Program was evaluated by MDRC under contract to the Florida De- 
partment of Children and Families. 

The Minnesota Family Investment Program was evaluated by MDRC under contract to the Min- 
nesota Department of Human Services. 

The National Evaluation of Welfare-to-Work Strategies is being conducted by MDRC under 
contract to the U.S. Department of Health and Human Services. The Child Outcomes Study, 
which examines program impacts on young children, is being conducted by Child Trends under 
subcontract to MDRC. 

The New Hope program is being evaluated by MDRC under contract to the New Hope Project, 
Inc., in collaboration with researchers from Northwestern University, the University of Texas at 
Austin, the University of Michigan, and the University of California at Los Angeles. 

The Self-Sufficiency Project was conceived by Human Resources Development Canada. The 
project is being managed by the Social Research and Demonstration Corporation (SRDC) and 
evaluated by SRDC and MDRC. 



A. The Minnesota Family Investment Program (MFIP ) 33 

MFIP was begun as a pilot program in 1994 and implemented in seven urban and rural 
counties in Minnesota until 1998. 34 The child study included single-parent families who were ap- 
plying for or currently receiving welfare. MFIP combined mandatory employment services and 
“make- work-pay” supplements. These earnings supplements were provided for either lull- or 
part-time work. Children were assessed three years after parents’ enrollment in the program. The 
evaluation tested two pilot programs, 35 and welfare recipients were randomly assigned to one of 
three groups — the control group or one of the two programs: 



33 Gennetian and Miller, 2000; Knox, Miller, and Gennetian, 2000; Miller, Knox, Gennetian, Hunter, Dodoo, and 
Redcross, 2000. 

34 In 1998, a modified version of MFIP was implemented statewide. Statewide MFIP includes a less generous 
earnings supplement and a more stringent participation mandate than the pilot program and a time limit on cash as- 
sistance receipt. 

35 Strictly speaking, MFIP was a single program encompassing the full program and a variant thereof, but for the 
purposes of this monograph the full program and its variant are referred to as separate programs. 
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• Full MFIP combined all the features of the MFIP program into a single pack- 
age. The most important features of this package included (1) an earnings sup- 
plement that allowed working welfare recipients to keep more of their income 
when they went to work (also known as an increased earnings disregard); (2) 
mandatory employment services requiring long-term welfare recipients to par- 
ticipate in employment or training activities unless they were working more 
than 30 hours per week or had a child under 12 months old; (3) child care 
payments made directly to the provider; and (4) a streamlining of the rules for 
disbursement of cash assistance in which (a) the AFDC, Food Stamp, and 
Family General Assistance programs were consolidated and Food Stamps 
were “cashed out” (that is, the Food Stamps’ dollar value was included in the 
welfare check) and (b) the eligibility rules for single-parent and two-parent 
families were equalized. 

• MFIP Incentives Only included all the features of the Full MFIP program 
except mandatory employment services. 

B. The Self-Sufficiency Project (SSPV 6 

This program was launched in 1992 and operated in two provinces in Canada (New 
Brunswick and British Columbia) until 2000. SSP took a pure make-work-pay approach, offering 
a generous earnings supplement for full-time work (at least 30 hours per week) for up to three 
years. The earnings supplement was a monthly cash payment available to single-parent welfare 
recipients who had been in Canada’s welfare program for at least one year and who chose to 
leave welfare for full-time work within a year of being offered the supplement. The amount of 
the supplement was calculated as half the difference between a recipient’s earnings and an earn- 
ings benchmark set such that a parent with a full-time minimum-wage job would roughly double 
her income if she received the supplement. Data on children were collected three years after par- 
ents were enrolled in the program. 

C. The New Hope Program 37 

New Hope operated in two low-income areas of Milwaukee, Wisconsin, from 1994 until 
1998. Because the program was targeted at low-income families who were willing to work full 
time, the study included both welfare recipients and other low-income parents. New Hope in- 
cluded various make-work-pay strategies. As in SSP, parents who worked full time (at least 30 
hours per week) were eligible for a cash supplement that was intended to bring their income to 
the poverty line. They could also elect to receive child care and health insurance subsidies. In this 
program, then, in-kind benefits were available to families in addition to the cash supplement. To 
help families take advantage of the program’s benefits, New Hope also provided intensive case 
management and, for parents who did not find full-time work, short-term community service 
jobs. Assessments of children were made two years after parents were randomly assigned either 
to the program or the control group. 



36 Michalopoulos, Card, Gennetian, Harknett, and Robins, 2000; Morris and Michalopoulos, 2000 
Bos et al., 2000. 
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D. The National Evaluation of Welfare-to-Work Strategies (NEWWS ) 38 



The part of NEWWS examined here 39 included six programs in three sites (Atlanta, Geor- 
gia; Grand Rapids, Michigan; and Riverside, California) that operated in the early to mid 1990s 
under the federal Job Opportunities and Basic Skills Training (JOBS) Program, which preceded 
TANF. Like TANF, the primary objective of these programs was to reduce single parents’ 
welfare use and increase their employment. The programs required welfare recipients to partici- 
pate in basic education or employment-related activities as a condition of receiving welfare. 
Families who failed to meet the participation requirements could receive sanctions. 

For purposes of the evaluation, each of the three sites examined here operated both a 
program stressing job search as a first activity and a program stressing basic education as a 
first activity; all three sites served welfare recipients. This design permitted a direct, side-by- 
side comparison of the two approaches. Information on children was collected as part of the 
Child Outcomes Study 40 two years after parents were randomly assigned to one of the two pro- 
grams at their site. 

• Job-search-first programs. These programs required most participants to 
look for work immediately, usually by attending a “job club” that lasted one to 
three weeks. Most people who completed job search without finding a job 
were then enrolled in short-term adult basic education, vocational training, or 
work experience. 

• Education-first programs. These programs initially placed participants in 
education and training programs (usually adult basic education or vocational 
training) to increase welfare recipients’ “human capital” (knowledge and 
skills) before they attempted to move into employment. 

E. Florida’s Family Transition Program (FTP ) 41 

FTP operated in Escambia County (which includes the city of Pensacola) between 1994 
and 1999. 42 The program combined a small earnings supplement with a time limit on the receipt 
of welfare benefits. The supplement, which was provided through the welfare system as an en- 
hanced earnings disregard, provided only a small amount of additional income to families who 
took advantage of it because the welfare benefit levels in Florida were quite low. Receipt of cash 
assistance was limited to 24 or 36 months (depending on the parents’ level of disadvantage) in 
any 60-month period. However, exemptions were granted to parents who became disabled or in- 
capacitated while receiving assistance (these recipients’ “welfare clocks” were stopped so that 
not all the months of welfare benefits they received were counted). Parents in FTP were also pro- 



38 Freedman, Friedlander, Hamilton, Rock, Mitchell, Nudelman, Schweder, and Storto, 2000; Hamilton, 2000; 
McGroder, Zaslow, Moore, and LeMenestrel, 2000. 

39 The programs discussed here are among the 1 1 programs operating in seven sites that were evaluated as part of 
NEWWS (Freedman et al., 2000). 

40 McGroder et al., 2000. 

4l Bloom, Kemple, Morris, Scrivener, Verma, and Hendra, 2000. 

42 FTP was a precursor of Florida’s WAGES (Work and Gain Economic Self-Sufficiency), a statewide program 
that operated from 1996 to 2000 and shared many of FTP’s features but differed from it in key ways. 
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vided with an array of services to help them find work in which they were required to participate 
or risk facing sanctions. Several child-focused mandates — one requiring parents to ensure that 
their children were immunized and the other that their children were attending school regularly 
(with stipulations about regular parent-teacher contact) — were also imposed. Unlike the other 
studies examined in this monograph, the control group in FTP was also subject to some manda- 
tory employment services; however, the mandatory services in the FTP group were more com- 
prehensive and monitored participants more closely. Data on children were collected four years 
after parents’ enrollment in the FTP or control group, making FTP’s follow-up period the longest 
of all those in the studies examined here. 

VI. Comparisons Across Programs 

As the thumbnail program descriptions show, few of the welfare reform approaches tested 
in the studies included only one of the program features described earlier. Rather, because poli- 
cymakers often design programs with multiple goals in mind, most of the programs “packaged” 
two or more of the features together. Those that included only one of the three features examined 
here provide the most compelling information about that particular component’s effect on chil- 
dren. Those with multiple features cannot provide direct evidence about the effects of single fea- 
tures because features may interact in affecting children’s outcome. For example, earnings sup- 
plements may have different effects on children when combined with mandatory employment 
services than when offered alone. However, programs with multiple features can shed light on 
how different features work together in influencing children’s outcomes and how the addition of 
a specific feature to the mix influences the effects of particular policy approaches. Finally, pro- 
grams that have been studied using a multiple-research-group design (such as MFIP) allow for a 
rigorous assessment of the effects of adding a specific feature to a set of other features (in the 
case of MFIP, adding mandatory employment services to an earnings supplement). 

Table 1.1 characterizes the 11 programs under study with respect to whether they in- 
cluded earnings supplements, mandatory employment services, and time limits to illustrate what 
can be learned from comparing the effects of the different programs. The programs in NEWWS 
provide the best information on the effects of mandatory employment services alone because they 
provide mandatory employment services without earnings supplements or time limits. The other 
five programs all included earnings supplements. Of the five, only three programs offered a gen- 
erous earnings supplement in the absence of mandatory employment services and time limits, 
although they differ in other respects (for instance, in the extent of case management and in the 
use of in-kind benefits in supplement packages). The Full MFIP program affords information on 
the effects of a generous earnings supplement combined with mandatory employment services 
and, when compared with the MFIP Incentives Only program, provides information on the ef- 
fects of adding a mandate to a generous earnings supplement. Finally, only one program with 
time limits — FTP — has been studied to date, making our conclusions about the effects of time 
limits necessarily tentative. Moreover, because in FTP time limits were combined with manda- 
tory employment services and a small earnings supplement, we can analyze the effects of time 
limits only when they are combined with other features. 
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How Welfare and Work Policies Affect Children 
Table 1.1 

Features of Each Program, by Study 



Study 


Earnings 

Supplements 


Mandatory 

Employment 

Services 


Time Limits 


MFIP 


/ 


/ 




Full MFIP 


✓ 


V 




MFIP Incentives Only 


s 






SSP 


s 






New Hope 


s 






NEWWS 








Atlanta Job-Search-First 




s 




Atlanta Education-First 




s 




Grand Rapids Job-Search-First 




s 




Grand Rapids Education-First 




s 




Riverside Job-Search-First 




s 




Riverside Education-First 




s 




FTP 


s 


s 





Although there has been considerable discussion about how the 1996 federal legislation 
altered welfare policy, many of the features that have been incorporated into programs since 1996 
were already being tested in these studies before 1996. Thus, these studies are a powerful tool for 
understanding how some post-TANF programs might be affecting children. 

VII. Time Periods of the Studies 

All the studies examined programs that began to be implemented prior to the 1996 wel- 
fare law. Nevertheless, there is some important variation in the study periods and therefore in the 
economic and policy conditions under which the studies took place. The earliest programs are 
those analyzed as part of the NEWWS evaluation. In these programs, families were randomly 
assigned to program and control groups between 1991 and 1993, and children were assessed two 
years later (between 1993 and 1995). Thus, the entire study period predated PRWORA’s passage 
in 1996. The periods of the MFIP, New Hope, and FTP studies, in contrast, overlapped with 
PRWORA’s passage, with families’ being randomly assigned between 1994 and 1995 and chil- 
dren’s being followed up in or after 1996. 

The evaluation of SSP, which operated in Canada, spanned both of these periods, with 
families’ being randomly assigned between 1992 and 1995 and children’s being assessed be- 
tween 1995 and 1998. As in the United States, the Canadian government passed legislation in 
1996 that turned welfare into a federally funded block grant, giving localities considerable discre- 
tion. However, unemployment was considerably higher in the provinces in which SSP was as- 
sessed than it was in the United States, although the local economic conditions improved slightly 
over the study period. 
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This discussion underscores the range of economic and policy conditions under which 
these studies were conducted. Consistent findings across these studies would support stronger 
conclusions about the effects of particular program features and generalization of the findings to 
a wider range economic and policy contexts than would otherwise be warranted. Inconsistent 
findings across studies might be attributable either to differences in the packages of features the 
programs offered or to differences in the conditions under which the studies occurred, thereby 
complicating the conclusions that can be drawn from the cross-study comparison. Nevertheless, 
the relatively short period of time over which these studies took place reduces the possibility that 
drastic differences in economic conditions underlie differences in the studies’ findings. 



VIII. Sample, Measures, and Analysis Strategy 

A. Sample 

We focus on children of single parents (primarily single mothers) who were of preschool 
age or early school age at the time of their parents’ random assignment (approximately 3-9 years 
at random assignment). 43 These children had reached middle childhood (approximately 5-12 
years) by the end of the follow-up period, from two to four years later. This age group was cho- 
sen as the basis for the cross-study analysis to maximize the comparability of the samples across 
the 1 1 programs and because this age group was the subject of a set of detailed questions about 
social behavior and well-being in all the studies. Thus, the data collected allow for a fair com- 
parison of program impacts across studies. 

Focusing on children of preschool and early school age has additional advantages. First, 
the most reliable assessments of children’s functioning available in developmental psychology 
are designed for children in this age range. Second, there is reason to believe that this age group 
contains the children most likely to be affected by changes in welfare and employment programs 
because they are young enough to react negatively to maternal separations and to be placed in 
nonmatemal care. At the same time, research has suggested that the youngest of these children 
(those aged 3-5) may benefit the most from increases in income. 

In all the studies, some data were collected on other age groups of children as well, but in 
most cases the information was too limited to allow for systematic analysis. In Chapter 5, we 
briefly discuss the effects on adolescent children found in the two studies for which more de- 
tailed information was collected and analyzed. Future research will analyze the differential ef- 
fects of welfare and employment programs on younger and older children in greater detail. 



43 Although we focus on preschool-aged and early school-aged children in many of the analyses in this mono- 
graph, the age groups are not identical across the 1 1 programs discussed. The footnotes in the figures specify the 
subgroups of children for whom data are presented. In cases in which the age group included children beyond those 
who were aged 3-9 at random assignment, analyses were conducted to determine if the effects are comparable when 
the sample of children was limited to those in the narrower age range. When the effects are indeed comparable, the 
results for the larger age group are shown in the figure to include the largest possible sample of children. 
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B. Measures 



To increase the comparability of the results found in the different studies, we examined a 
subset of measures that was similar across studies but that represented the range of children’s 
outcomes that might be affected by welfare and employment policies. The findings on the full set 
of measures of children’s well-being can be found in the reports on the individual studies . 44 Here 
we examine effects in three broad categories: cognitive or achievement outcomes, social behav- 
ior, and health. 

Children’s cognitive outcomes include school achievement as rated by parents and teachers 
as well as children’s test scores. Test scores can provide information about children’s actual knowl- 
edge of a particular area, while parents’ and teachers’ reports provide information on how children 
are performing in school, which likely reflects both their cognitive abilities and their engagement in 
school. Some of the studies included only reports by parents, while others included information 
from more than one source. 

Both positive and negative aspects of children’s social behavior are also examined. In 
terms of behavior problems, the analyses presented here focus on externalizing behavior (chil- 
dren’s “acting out” and engagement in overtly negative interactions such as yelling at and fight- 
ing with adults and peers) rather than internalizing behavior (depression and anxiety). We devote 
our attention to externalizing rather than internalizing behavior both because the former is more 
easily and accurately assessed by parents and teachers and because it has been shown to be influ- 
enced more than internalizing behavior by child- focused interventions . 45 We also look at chil- 
dren’s positive social behavior as measured by the extent to which children are helpful and coop- 
erative in their interactions with others. 

Finally, we analyze parents’ ratings of children’s general health. In most studies, these 
ratings are responses to a single question. 

In general, test scores and reports by adults other than parents are more reliable methods 
of assessing the effects on children of programs aimed at parents than are parents’ reports. Be- 
cause program group parents’ perceptions of their children may be influenced by their experi- 
ences in the program, differences between their reports and those of control group members may 
reflect those differences in perception rather than or in addition to differences in children’s actual 
functioning. For example, parents who are stressed by being employed may perceive their chil- 
dren as more poorly behaved than parents who are less stressed, even if the behavior of the chil- 
dren in the two groups is the same. Similarly, parents who are working may be more aware of 
their children’s health problems than parents who are not because employed parents might have 
to miss work when their children are sick. These caveats are not intended to imply that parents’ 
reports are not useful sources of data. In fact, to the extent that they translate into parents’ behav- 
ior toward children, they may be very accurate at predicting long-term outcomes for children. 
However, in assessments of the effects of these programs on children, teachers’ reports and chil- 
dren’s test scores should be weighed more heavily than parents’ reports. 



44 Bloom, Kemple, et al., 2000; Bos et al., 1999; Gennetian and Miller, 2000; McGroder et al., 2000; Morris and 
Michalopoulos, 2000. 

45 Yoshikawa, 1995. 
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C. Analysis Strategy 



Each of the studies examined in this monograph used a random assignment research de- 
sign to measure the effects, or impacts, of the program(s) on various measures of outcomes for 
parents and children. We computed the impacts on the measures described in the previous sec- 
tion. In reporting impacts, we often refer to the differences that emerged over time between the 
groups as “increases” or “decreases.” 

For each impact, we conducted a statistical test 46 to determine if the impact was statisti- 
cally significant. Some differences between the program and control groups might arise from 
chance. A test of statistical significance indicates when an impact is unlikely to be due to such 
chance differences between groups. Unless otherwise noted, every “impact” and “effect” men- 
tioned in this document was determined to be statistically significant. 

The programs’ impacts are represented here in terms of effect sizes. A larger effect size 
(whether positive or negative) corresponds to a larger effect. Effect sizes are computed by dividing 
the difference between the average program and control group outcomes on a particular measure by 
the standard deviation of the control group members’ outcomes on that measure. 47 (The standard 
deviation of a set of observations captures their degree of “spread,” or how variable they are relative 
to the average outcome.) The effect size is a yardstick for measuring impacts that can be used to 
compare effects even when they are measured on different scales or in research samples that have 
different standard deviations. For example, effect size analysis allows us to determine whether a 5- 
point difference between the program and control groups in the percentage of children performing 
below average in school is similar in magnitude to a 10-point difference between the program and 
control groups’ average scores on a test graded on a scale from 1 percent to 100 percent. 

Random assignment designs make it possible to attribute systematic differences between 
the program and control groups to the different programs the two groups experienced. In this 
monograph, however, we compare the effects of the different program approaches across studies. 
Inferences based on cross-study comparisons are more tenuous than those made within a particu- 
lar study because factors other than the differences in program models may explain why the find- 
ings from two studies differ. Wherever possible, we attempt to address this problem by selecting 
similar subgroups for comparison. However, this technique is far from perfect, and other factors 
may still confound comparisons across studies. 



46 Specifically, a two-tailed test was performed for each difference in outcomes between the program and control 
groups to determine whether it was statistically significant. In the studies in which more than one child per family 
was included in the study sample, the statistical tests were adjusted to account for the relation between siblings. Dif- 
ferences between subgroup impacts were also tested for statistical significance. 

47 The control group standard deviation is used because the program may affect the degree of spread in the pro- 
gram group (for example, the program may help some children and hurt others, thereby increasing the standard de- 
viation). Using the control group standard deviation allows one to examine the difference as a function of the varia- 
tion in the control group’s environment. 
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Chapter 2 

Effects on Children of Programs with Earnings Supplements 

Earnings supplements are designed to encourage work and reduce poverty. Given that 
children are negatively affected by poverty, increasing income through earnings supplements 
might be expected to benefit children. But to receive an earnings supplement parents have to 
work, and some of the programs examined here required that parents work full time. It is there- 
fore possible that the increases in employment produced by earnings supplements lead to nega- 
tive effects on children that undermine the positive effects of higher family income. This chapter, 
which is based on a reanalysis of the data from three of the five studies introduced in Chapter 1 
(MFIP, SSP, and New Hope 1 ), speaks to these issues by analyzing the effects on children of earn- 
ings supplement programs. 

I. Effects on Parents’ Economic Outcomes 

Because programs that provide earnings supplements are targeted at adult behavior, they are 
most likely to affect children through changes in economic outcomes for parents. Here we briefly 
describe the effects of the programs with earnings supplements analyzed in this monograph with 
respect to three economic outcomes: employment, welfare receipt (the proportion of families re- 
ceiving welfare), and income. This summary is based on a companion document 2 that examines the 
effects of these and other programs on parents’ economic outcomes in greater detail. 3 

• Earnings supplement programs are intended to increase employment, 
and those examined here appear to have achieved this goal. 

The programs with earnings supplements generally increased employment, although pri- 
marily for long-term welfare recipients. Whether the increase is in full-time employment (30 or 
more hours per week) or part-time employment depends on the nature of the supplement. For ex- 
ample, because the MFIP Incentives Only program rewarded part-time work more than full-time 
work (families in which parents worked part time actually experienced a larger income boost 
from the program than families in which parents worked full time), the program increased pri- 
marily part-time employment for long-term welfare recipients. SSP, in contrast, increased frill- 
time more than part-time work, because its supplements were contingent on full-time employ- 
ment. The Full MFIP program, which included both an earnings supplement and a mandate for 
full-time work, also increased full-time employment for long-term welfare recipients. 

• The effects of the earnings supplement programs examined here on wel- 
fare use depended largely on the way in which the supplement was pro- 
vided. 



'For the MFIP evaluation, see Gennetian and Miller, 2000, and Knox, Miller, and Gennetian, 2000; for the SSP evalua- 
tion, see Morris and Michalopoulos, 2000; and for the New Hope evaluation, see Bos et al., 1999, and Huston, Duncan, 
Granger, Bos, McLoyd, Mistry, Crosby, Gibson, Magnusson, Romich, and Ventura, forthcoming, 2001. 

2 Bloom and Michalopoulos, 2001. 

3 Note that in describing the effects of SSP, Full MFIP, and MFIP Incentives Only, we have focused on long- 
term welfare recipients. Later in this chapter, we discuss outcomes for families in these studies with shorter welfare 
histories. 
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The two programs that provided earnings supplements inside the welfare system by in- 
creasing the earnings disregard (Full MFIP and MFIP Incentives Only) increased both welfare 
receipt and welfare payments as they increased employment for long-term welfare recipients. 
This is because more working families qualified for welfare in these programs than would have 
qualified under the AFDC system. One of the two programs that provided supplements outside 
the welfare system in the form of cash and/or in-kind benefits (SSP), in contrast, reduced welfare 
receipt, but both programs that provided supplements outside the welfare system (SSP and New 
Hope) — unsurprisingly — increased receipt of assistance in the form of supplements. 

• Most importantly, the earnings supplement programs increased income 
and reduced poverty. 

Because these programs supplemented the earnings of families who went to work, the income 
levels of families in the program groups in the studies examined here were typically much higher than 
those of families in the control groups. For example, long-term welfare recipients in Full MFIP had 
income levels about $1,200 per year higher on average than those in the control group. 

• Because the programs with earnings supplements increased cash trans- 
fers to families, these programs cost the government money. . 

Earnings supplements can increase earnings and income but at a cost to the government. 
For example, the net cost of MFIP per family for services, cash assistance, and Medicaid was 
about $2,000 per year for single-parent long-term recipients, and SSP’s net cost per family was 
about $450 per year — all of it spent on cash assistance because the program did not offer special 
services. New Hope was the most expensive of the three programs partly because it provided a 
more comprehensive package of services and partly because it generated smaller welfare savings 
(some families in the study were not welfare recipients to begin with). The net cost of New Hope 
per family was about $4,000 per year. 

II. Effects on Children 

We first consider the effects on children of the three earnings supplement programs that 
did not include any form of mandatory employment services (MFIP Incentives Only, SSP, and 
New Hope). All three programs gave parents a supplement if they went to work by providing 
cash, and New Hope offered additional family supports (child care and health insurance subsi- 
dies) to parents who worked. 

All three programs shared one feature: the provision of a generous earnings supplement. 
However, in other ways these three programs were quite different — for example, with respect to 
whether the earnings supplement was tied to full-time work. In the MFIP Incentives Only pro- 
gram, supplements were provided to families for any amount of work and were more generous 
for part-time work than for full-time work. In SSP and New Hope, in contrast, parents had to 
work full time (at least 30 hours per week) in order to receive the supplement. In addition, 
whereas MFIP Incentives Only provided the supplement within the welfare system by raising the 
earnings disregard, SSP and New Hope did so outside the welfare system. Finally, the three pro- 
grams differed with respect to whether they provided in-kind benefits in addition to cash assis- 
tance. New Hope earmarked part of the benefits for particular uses (child care and health insur- 
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ance), while MFIP Incentives Only and SSP provided a cash supplement that families could 
spend as they wished. 

The findings presented are for the child samples in the SSP and New Hope evaluations 
(children of single-parent welfare recipients in SSP 4 and children of low-income single parents in 
New Hope) and for the children of the urban, single-parent long-term welfare recipients in the 
MFIP Incentives Only program, 5 which included the largest sample of children examined in the 
MFIP evaluation. Later in this chapter, we present the programs’ impacts for children of different 
ages and for girls and boys. Box 2.1 provides a guide to reading the figures in this monograph. 

Figure 2.1 shows the impacts of the three earnings supplement programs that did not pro- 
vide mandatory employment services on children’s achievement as measured by parents’ ratings 
and children’s math test scores. As explained in Box 2.1, each bar represents — on a common 
scale across programs — the difference between the program and control groups. In one of the 
studies, only ratings by parents were collected. In the other two programs, additional information 
about the effects of these programs on children’s school achievement was obtained from test 
scores or ratings by teachers. 

• All the programs that provided earnings supplements without mandatory 
employment services improved children’s school achievement. 

As can be seen in Figure 2.1, these three earnings supplement programs improved chil- 
dren’s achievement in school, increasing it by about 10 percent to 15 percent of the average 
variation in the control group. These results suggest that these kinds of programs have small but 
statistically significant positive effects (for a discussion of the size of these effects, see Box 2.2). 
The study of the MFIP Incentives Only program, which measured children’s achievement solely 
on the basis of parents’ ratings, found positive effects on this measure. The SSP study, which in- 
cluded ratings by parents as well as children’s test scores, found improvements on both meas- 
ures. The New Hope study included ratings by both parents and teachers. While New Hope was 
found to have no effects on parents’ ratings of children’s achievement, the program had a posi- 
tive impact on teachers’ ratings. Interestingly, despite the differences in these programs’ ap- 
proaches — for instance, with respect to whether they provided the supplement within or outside 
the welfare system, made the program contingent on full-time employment, or earmarked the 
supplements for particular work or family supports — all three programs had similar, positive 
effects on children’s achievement outcomes. 

• Programs with earnings supplements had either neutral or favorable ef- 
fects on children’s behavior problems and positive behavior. 

Figure 2.2 shows the effects of the same three programs on children’s externalizing be- 
havior problems (as opposed to internalizing problems such as depression and anxiety). Separate 
bars show the effects as measured by parents’ and teachers’ ratings. While there was a reduction 
in children’s behavior problems in the MFIP Incentives Only program, in SSP and New Hope 



4 In SSP, the study sample included only welfare recipients who had been receiving welfare for at least one year. 

5 At the time of their random assignment to the program or control group, all the long-term welfare recipients in 
the MFIP Incentives Only program had been receiving welfare for at least two years. 
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How Welfare and Work Policies Affect Children 



Box 2.1 

How to Read the Figures in This Monograph 

Most of the figures in this report show the impacts of specific welfare reform initiatives. Below is a table 
that uses data from the SSP evaluation to illustrate the types of information the figures represent. The ta- 
ble shows — for the program group and the control group separately — the average rating by parents of 
children’s school achievement (expressed on a five-point scale where 1 means “not very well at all” and 5 
means “very well”) averaged across three academic subjects and children’s average score on a math skills 
test (expressed as the proportion of items answered correctly). 

Cognitive Outcomes, Impacts, and Effect Sizes in the SSP Evaluation 



Program Group 
Average 



Control Group Difference Effect Size 
Average (Impact) 



Parents’ ratings of achievement 3.71 

Children’s math test scores 0.56 



3.61 0.10** 0.11** 

0.52 0.04** 0.14** 



The table also shows the differences between the program and control group averages — that is, the pro- 
gram’s impacts. The difference between the average achievement ratings given by parents in the program 
and control groups was .10. The average math test scores of children in the two groups differed by .04; that 
is, children in the program group had an average score that was 4 percentage points higher than the average 
score of children in the control group. 

The final column of the table converts each impact into an effect size by dividing the difference between the 
program and control group averages on each achievement measure by the standard deviation of the control 
group outcomes — that is, their degree of “spread,” or how variable they are relative to the average outcome. 
This procedure standardizes the impact estimates to allow comparison across measures. In this case, it shows 
that the impact of .10 on parents’ achievement ratings is similar in magnitude to the impact of .04 on math test 
scores. Both effect sizes represent a change of about 10 percent to 15 percent of the average variation in the 
outcomes. The bar charts used in this report graph these effect sizes as in the figure below. The program and 
control group averages underlying all the effect sizes shown in the figures are provided in the Appendix. 




In most of the figures, stars appear above some of the bars, which means that the differences between the 
program and control groups on the measures indicated are statistically significant, that is, unlikely to be due 
to chance. In the figures showing impacts for subgroups such as boys and girls, the figure notes indicate 
whether the differences between the subgroup impacts are statistically significant. Unless otherwise noted, 
all the impacts (sometimes called effects) discussed in the text are statistically significant. 
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How Welfare and Work Policies Affect Children 



Figure 2.1 

The Three Earnings Supplement Programs Without Mandatory Employment Services 
Improved Children’s School Achievement 
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Cash supplement for full-time Cash supplement and other 
work (SSP) subsidies for full-time work 

(New Hope) 



NOTES: In each study, children were selected for inclusion in the sample on the basis of their age at random assignment or 
their age at follow-up. 

The MFIP sample includes children of parents in the MFIP evaluation aged 5-12 at the time of the three-year follow- 
up survey (aged approximately 2-9 at the time of random assignment) whose parents were long-term recipients.in urban 
counties and underwent random assignment between April 1, 1994, and October 31, 1994 (sample size for MFIP Incentives 
Only = 573). 

The SSP sample includes children of single parents in the SSP evaluation aged 6-11 at the time of the three-year 
follow-up survey (aged approximately 3-8 at random assignment) who were living in the home at the time of random 
assignment and at the time of the three-year follow-up survey (sample size = 2, 158). 

The New Hope sample includes children of the single parents in the New Hope evaluation who were aged 1-10 at 
random assignment and whose parents participated in the two-year follow-up survey (sample size = 832). 

Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; *** = 1 percent (two-tailed test). 

In MFIP, achievement was assessed using a single-item measure that asked parents to rate their child’s overall 
performance in school on a scale ranging from 1 (“not well at all”) to 5 (“very well”). 

In SSP, achievement was measured using a 26- to 34-item math skills test and expressed in terms of the proportion of 
items answered correctly. Parents’ assessments of achievement were measured using their ratings of their child’s functioning in 
three academic subjects on a five-point scale ranging from 1 (“not very well”) to 5 (“very well”). The ratings were averaged 
across the three academic subjects to compute a single score for each child. 

In New Hope, teachers’ reports of achievement were measured using the 10-item Academic Subscale from the Social 
Skills Rating System, which asked teachers to rate the child’s skills relative to those of other children in areas such as math, 
reading, and oral communication on a five-point scale ranging from 1 (“bottom 1 0 percent”) to 5 (“top 1 0 percent”). The 
responses were averaged across the 10 items to compute a single score for each child. Parents’ assessments of achievement were 
measured using a single-item measure that asked parents to rate their child’s school performance, based on past report cards or 
other sources, on a five-point scale ranging from 1 (“not at all well”) to 5 (“very well”). 
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How Welfare and Work Policies Affect Children 



Figure 2.2 

One Earnings Supplement Program Without Mandatory Employment Services 
Reduced Children’s Behavior Problems 



Q Parents 1 reports * Teachers* reports 




(New Hope) 



NOTES: In each study, children were selected for inclusion in the sample on the basis of their age at random assignment or 
their age at follow-up. 

The MFIP sample includes children of parents in the MFIP evaluation aged 5-.12 at the time of the three-year follow- 
up survey (aged approximately 2-9 at the time of random assignment) whose parents were long-term recipients in urban 
counties and underwent random assignment between April 1, 1994, and October 31, 1994 (sample size for MFIP Incentives 
Only = 573). 

The SSP sample includes children of single parents in the SSP evaluation aged 6-1 1 at the time of the three-year 
follow-up survey (aged approximately 3-8 at random assignment) who were living in the home at the time of random 
assignment and at the time of the three-year follow-up survey (sample size = 2,158). 

The New Hope sample includes children of the single parents in the New Hope evaluation who were aged 1-10 at 
random assignment and whose parents participated in the two-year follow-up survey (sample size = 832). 

Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; *** = 1 percent (two-tailed test). 

In MFIP, behavior problems were measured using parents' responses to a 12-item externalizing subscale of the 
Behavioral Problems Index that assesses aggressive behaviors such as bullying and cheating. Responses range from 0 (“not 
true”) to 2 (“very true”). The responses to the 12 questions were summed to compute a single score for each child. 

In SSP, behavior problems were measured using a four-item externalizing subscale that asked parents to assess their 
child’s acting out and aggressive behaviors on a three-point scale ranging from 1 (“never”) to 3 (“often”). The responses were 
averaged across the four items to compute a single score for each child. 

In New Hope, behavior problems were measured using a six-item externalizing subscale of the Problem Behavior 
Scale from the Social Skills Rating System that asked parents and teachers about the child’s aggressive behavior and how often 
the child needed to be disciplined for misbehavior on a five-point scale ranging from 1 (“never”) to 5 (“all the time”). The 
responses were averaged across the six items to compute a single score for each child. 
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there were no positive or negative effects. 6 These findings suggest that, if these programs influ- 
ence children’s behavior problems at all, their effects are favorable. 

Turning to children’s positive behavior (positive social interactions with others), we see 
similar results, with increases in children’s positive behavior in two of the three studies (MFIP 
Incentives Only and New Hope; see Figure 2.3). Whereas MFIP’s positive effects were found for 
parents’ ratings of children’s positive behavior (no ratings by teachers were collected), New 
Hope’s were limited to teachers’ ratings (although ratings by both parents and teachers were col- 
lected). As with behavior problems, favorable effects on positive behavior were observed in 
some but not all studies, but the effects found were never unfavorable. 

• Programs with earnings supplements had either neutral or positive effects 
on children’s health. 

Only two of the studies, MFIP Incentives Only and SSP, included data on children’s 
health, and in both cases these data were parents’ ratings. SSP increased ratings of children’s 
health (see Figure 2.4), but this finding was not replicated in MFIP Incentives Only. Thus, as 
with the findings on children’s behavioral outcomes, the single effect that was observed was fa- 
vorable but was not found in MFIP Incentives Only. 



How Welfare and Work Policies Affect Children 
Box 2.2 

How Large Are These Effect Sizes? 

Understanding effect sizes 

One way to understand how large the effects of the programs considered here are is to 
compare them with the programs’ effects on related measures. For example, Full MFIP had an ef- 
fect on school achievement of .15 and an effect on behavior problems of -.17. The program also 
reduced the proportion of children performing below average in school by 5 percentage points and 
the proportion of children with a high level of behavior problems by 8 percentage points. 1 

Another way of judging whether a given effect is large or small is to relate its size to the 
kinds of percentile scores associated with school tests. Children in the studies examined in this 
monograph scored at around the 25 lh percentile on most of the standardized tests they took (mean- 
ing that 25 percent of children nationally scored below the average child in the control group in the 
studies examined here). A positive impact on test scores with an effect size of . 15 would amount to 
about a 5 percentile point improvement, implying that their average percentile ranking rose from 
the 25 th to the SO 1 * 1 percentile (so that at the end of the follow-up period they would rank above 30 
percent of children nationally). An effect size of .25 amounts to about an 8 percentile point differ- 
ence, implying that their average percentile ranking rose to the 33 rd percentile. 

Similar logic applies to the effect sizes on all the measures reported. Suppose, for example, 
that a program has an effect of size .15 on children’s positive behavior. This would imply a child at 
the 25 ' percentile of the positive behavior distribution who experienced the average program im- 
pact would be at the 30 lh percentile of the positive behavior distribution at the end of the study. 

(continued) 



6 As reported later in this chapter, New Hope decreased boys’ behavior problems but increased girls’ behavior 
problems. 
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Box 2.2 (continued) 



How do these effects compare with those on adult economic outcomes? 

The effects on children of the earnings supplement programs are about one-half to one- 
third as large as those on adult economic outcomes. Generally, the programs increased employ- 
ment rates by about 10 percentage points and reduced poverty by a similar amount. Most of the 
impacts correspond to effect sizes of about .30, but on selected measures of employment they are 
as large as .50. The sizes of the effects on children are generally around .15. 

How do these effects compare with those of other interventions aimed — directly or indirectly — 
at children? 

Other programs aimed at improving outcomes for both parents and children — specifi- 
cally, parental employment and children’s development — include home-visiting programs, in 
which nurses or other paraprofessionals provide one-on-one case management to link low-income 
parents with services in their communities. Some such programs combine home-visiting services 
for parents with child development programs for children. A recent review, however, suggests that 
home-visiting programs are not always effective in improving parents’ and children’s function- 
ing. 2 However, studies of home-visiting programs in which improvements in children’s well-being 
were observed found effect sizes as large or larger than those presented here. For example, studies 
of the Infant Health and Development Program, a large-scale two-generational program combin- 
ing home visits with child development centers and peer support groups for parents of low birth- 
weight infants, reported effects ranging in size from about .40 to .80 on standardized test scores 
and an effect of -.18 on children’s behavior problems. 3 

Turning to programs directly targeted at children, the best known preschool programs 
have effect sizes much larger than those presented here and can be as large as 1.0. 4 Such large ef- 
fect sizes are not surprising considering that these are the most successful of childhood interven- 
tions and that they target children directly rather than being designed to affect children indirectly 
through changes in parents’ circumstances and behavior. Interestingly, however, the effects of 
preschool programs on test scores and school achievement are much more consistent than their ef- 
fects on behavioral outcomes, which some studies have found to be neutral or even negative. In a 
set of well-known experiments that investigated the effects of class size on children’s school per- 
formance, children were randomly assigned to classes of different sizes. Classes of smaller size 
improved children’s math and reading grades, with effect sizes ranging from approximately .15 to 
.35. 6 The effects of this intervention, which was targeted directly at school-aged children, are 
comparable in size to those of the parent-targeted programs examined here. 

Are these effects predictive of children 's long-term outcomes? 

In assessing the importance of a program’s effects on children, we should consider not 
only their size but also their relation to later outcomes. Longitudinal studies have found that chil- 
dren’s achievement and behavior problems can have important implications for their well-being in 
adolescence and adulthood. 7 Moreover, small differences between children in school achievement 
early on can translate into larger differences later. 8 Therefore, a program’s effects on children, 
even if the effects are small, may continue to have implications over the course of their lives. 




l Gennetian and Miller, 2000. 

2 Gomby, Culross, and Behrman, 1999. 

3 Infant Health Development and Program (IHDP), 1990. 

4 Shonkoff and Phillips, 2000. 

5 Yoshikawa, 1995. 

6 Word, Johnston, Bain, Fulton, Zaharias, Achilles, Lintz, Folger, and Breda, 1990; Krueger, 1997. 

7 Caspi, Wright, Moffit, and Silva, 1998; Masten, Coatsworth, Neemann, Gest, Tellegen, and Garmezy, 1995. 
8 Entwistle, 1985. 
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How Welfare and Work Policies Affect Children 



Figure 2.3 

Two Earnings Supplement Programs Increased 
Children’s Positive Behavior 
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Enhanced earnings disregard Cash supplement for full-time Cash supplement and other 
(MFIP Incentives Only) work (SSP) subsidies for full-time work 

(New Hope) 



NOTES: In each study, children were selected for inclusion in the sample on the basis of their age at random assignment or 
their age at follow-up. 

The MFIP sample includes children of parents in the MFIP evaluation aged 5-12 at the time of the three-year follow- 
up survey (aged approximately 2-9 at the time of random assignment) whose parents were long-term recipients in urban 
counties and underwent random assignment between April 1, 1994, and October 31, 1994 (sample size for MFIP Incentives 
Only = 573). 

The SSP sample includes children of single parents in the SSP evaluation aged 6-11 at the time of the three-year 
follow-up survey (aged approximately 3-8 at random assignment) who were living in the home at the time of random 
assignment and at the time of the three-year follow-up survey (sample size = 2, 1 58). 

The New Hope sample includes children of the single parents in the New Hope evaluation who were aged 1-10 at 
random assignment and whose parents participated in the two-year follow-up survey (sample size = 832). 

Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; *** = 1 percent (two-tailed test). 

In MFIP, positive behavior was measured with the 25-item Positive Behavior Scale, which included three subscales: 
compliance, social competence, and autonomy. Parents responded to each item on an 1 1 -point scale ranging from 0 (“not at all 
like my child”) to 10 (“completely like my child”). The responses to the 25 questions were summed to compute a single score 
for each child. 

In SSP , positive behavior was measured using the five-item Positive Social Behavior subscale, which asked parents 
to assess their child’s prosocial interactions with peers on a scale ranging from 1 (“never”) to 3 (“often”). The responses were 
averaged across the five items to compute a single score for each child. 

In New Hope, the child’s positive behavior was measured using the 25-item Positive Behavior Scale, which included 
three subscales: compliance, social competence, and autonomy. Parents and teachers responded to each item on a five-point 
scale ranging from 1 (“never”) to 5 (“all of the time”). The responses were averaged across the 25 items to compute a single 
score for each child. 
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How Welfare and Work Policies Affect Children 



Figure 2.4 

One Earnings Supplement Program Improved 
Children’s Health as Reported by Parents 




Enhanced earnings disregard Cash supplement for full-time work 
(MFIP Incentives Only) (SSP) 



NOTES: In each study, children were selected for inclusion in the sample on the basis of their age at random assignment or 
their age at follow-up. 

The MFIP sample includes children of parents in the MFIP evaluation aged 5-12 at the time of the three-year follow- 
up survey (aged approximately 2-9 at the time of random assignment) whose parents were long-term recipients in urban 
counties and underwent random assignment between April 1, 1994, and October 31, 1994 (sample size for MFIP Incentives 
Only = 573). 

The SSP sample includes children of single parents in the’SSP evaluation aged 6-11 at the time of the three-year 
follow-up survey (aged approximately 3-8 at random assignment) who were living in the home at the time of random 
assignment and at the time of the three-year follow-up survey (sample size = 2, 1 58). 

Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; *** = 1 percent (two-tailed test). 

In MFIP, health was assessed using a single-item measure that asked parents to rate their child’s health on a five-point 
scale ranging from 1 (“poor”) to 5 (“very good”). 

In SSP, health was measured using parents* responses to four questions about their child’s health on a scale ranging 
from 1 (“false”) to 5 (“true”). The responses were averaged across the four items to compute a single score for each child. 
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• Overall, the programs that provided earnings supplements without man- 
datory employment services improved child outcomes. Encouragingly, 
this finding suggests that such programs can both increase family re- 
sources and improve child outcomes. 

The findings are most consistent with regard to school achievement. Effects on children’s 
behavioral and health outcomes were not found across all studies, but those that were observed 
were favorable. 

These results are consistent with those of the studies reviewed in Chapter 1, most of which 
reported positive associations between family income and children’s well-being, particularly as re- 
flected in cognitive performance and school achievement. The fact that welfare programs with an 
antipoverty component can lead to improvements in children’s cognitive outcomes — improve- 
ments that are detected two to three years after their parents first enter the programs — has impor- 
tant implications for policy and program design. Furthermore, the consistency in the findings across 
the sites and studies considered here justifies greater confidence in the generalizability of the pro- 
grams’ effects. At the same time, most of the effects are small and are concentrated in children’s 
cognitive development rather than their behavior or health. It is not yet clear how to improve chil- 
dren’s behavior and health systematically across programs. 

III. Adding Mandatory Employment Services to an Earnings Supplement 

A given program feature may work differently when combined with other features than 
when studied in isolation. Because most state welfare programs are packages of features, under- 
standing how the features interact is critical to informing welfare policy. In this section, we ex- 
amine how earnings supplements interact with mandatory employment services. 

The MFIP evaluation permits a direct experimental comparison of earnings supplement 
programs with and without mandatory employment services. Whereas in Full MFIP parents were 
both subject to a participation mandate and provided with an earnings supplement, in MFIP In- 
centives Only parents were subject to all the same program features except the mandate. The 
evaluation provides a rigorous test of the effects of adding a mandate to supplements because 
parents were randomly assigned to one of these two groups or to a control group that was not of- 
fered either of the MFIP programs. Random assignment allows us to be confident that the differ- 
ences between the two programs’ effects are caused by the differences between the programs 
rather than by any unmeasured differences between participants. 

Both MFIP Incentives Only and Full MFIP increased employment for long-term welfare 
recipients. However, only Full MFIP led to an increase in full-time employment (30 hours or 
more per week), while the MFIP Incentives Only program boosted only part-time employment. 
From this result it appears that adding the mandate increased full-time employment relative to 
providing only earnings supplements. How do these increases in employment affect child out- 
comes in the two programs? One might hypothesize that higher employment has negative effects 
on children that undermine the positive effects of the higher family income resulting from earn- 
ings supplements. Alternatively, one might hypothesize that increases in full-time employment 
benefit children by making family routines more regular and providing children with positive role 
models. Another hypothesis is that mandatory employment services increase parental stress, irre- 
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spective of their effects on employment, and thereby reduce the positive effects of earnings sup- 
plements on children’s well-being. 

The impacts of the two MFIP programs on children are presented in Figure 2.5. The find- 
ings suggest that adding the participation mandate had no effect on parents’ ratings of children’s 
achievement in school, behavior problems, or health. The only outcome that appears to have been 
affected by the addition of the mandate was parents’ ratings of children’s positive behavior: 
While the effect is positive in the MFIP Incentives Only program, there is no effect in the Full 
MFIP program. Notably, Full MFIP did not produce any negative effects on children, even in the 
case of positive behavior. 

• Although drawn from a single study, these findings show that mandatory 
employment services need not reduce the positive effects on children of 
programs with earnings supplements. 

Programs with earnings supplements appear to increase children’s achievement — 
whether the supplements are provided alone or combined with a participation mandate that in- 
creases full-time work. 

IV. How Might These Programs Have Affected Children? Effects on 

Child Care, Parents’ Emotional Well-Being, and Parenting Behavior 

There are a number of possible explanations for the effects of the earnings supplement pro- 
grams discussed above. Through what mechanisms might the increases in parental employment and 
income caused by the programs benefit children? One possibility is that increased employment and 
financial stability improve parents’ emotional well-being or reduce their feelings of stress. This, in 
turn, may have a favorable influence on parents’ interactions with their children. Moreover, by in- 
creasing the use of child care (because of higher employment) and changing the type of child care 
that parents use (because of wider child care options made possible by higher income), earnings 
supplement programs introduce children to environments and educational opportunities to which 
they otherwise might not have been exposed. This, in turn, may enhance children’s emotional and 
cognitive development. All these are mechanisms through which programs like New Hope, Full 
MFIP, MFIP Incentives Only, and SSP might have affected children. 

It is critical to learn more about the mechanisms through which programs affect children 
and families because programs cannot always be fully replicated in new sites or locales, where 
different combinations of program features may be adopted or different factors — such as child 
care or parenting practices — may be specifically targeted. Attributing program effects on chil- 
dren to one or more specific mechanisms requires complicated statistical analyses beyond the 
scope of this synthesis. As outlined in more detail at the end of the monograph, future documents 
from the Next Generation project will present such analyses. In the present context, we simply 
explore the pathways by which these programs likely affected children. 

Possible mediators of program effects on child outcomes are child care, family relations, 
parental well-being, and parenting practices. Evidence from the studies reviewed here suggest 
that the four programs with generous earnings supplements affected a number of these possible 
mediating factors in generally positive ways; however, the nature of the effects varied across 
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How Welfare and Work Policies Affect Children 
Figure 2.5 

Adding Mandatory Employment Services to an Earnings Supplement Program 
Affected None of the Effects for Children Except Positive Behavior 



D Enhanced earnings disregard (MFIP Incentives Only) 

M Enhanced earnings disregard with work mandate (Full MFIP) 




School Achievement Behavior Problems Positive Behavior Health 



NOTES: The MFIP sample includes children of parents in the MFIP evaluation aged 5-12 at the time of the three-year follow- 
up survey (aged approximately 2-9 at the time of random assignment) whose parents were long-term recipients in urban 
counties and underwent random assignment between April 1, 1994, and October 31, 1994 (sample size for Full MFIP = 587; 
sample size for MFIP Incentives Only = 573). 

The statistical significance levels of the impacts are indicated as: * = 10 percent; ** = 5 percent; *** = 1 percent (two- 
tailed test). The statistical significance levels of the differences between impacts are not noted in the figure. The only difference 
between impacts that was statistically significant was that in positive behavior for MFIP Incentives Only and Full MFIP. 

Achievement was assessed using a single-item measure that asked parents to rate their child’s overall performance in 
school on a scale ranging from 1 (“not well at all”) to 5 (“very well”). 

Behavior problems were measured using parents’ responses to a 12-item externalizing subscale of the Behavioral 
Problems Index that assesses aggressive behaviors such as bullying and cheating. Responses range from 0 (“not true”) to 2 
(“very true”). The responses to the 12 questions were summed to compute a single score for each child. 

Positive behavior was measured with the 25-item Positive Behavior Scale, which included three subscales: 
compliance, social competence, and autonomy. Parents responded to each item on an 1 1 -point scale ranging from 0 (“not at all 
like my child”) to 10 (“completely like my child”). The responses to the 25 questions were summed to compute a single score 
for each child. 

Health was assessed using a single-item measure that asked parents to rate their child’s health on a five-point scale 
ranging from 1 (“poor”) to 5 (“very good”). 
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programs. New Hope increased the use of formal child care for young children, and other re- 
search has found that formal care arrangements are associated with greater cognitive readiness 
for school and improved social functioning among children. 7 Full MFIP also increased the use of 
formal and stable child care for children of long-term welfare recipients, but the MFIP Incentives 
Only program did not. SSP increased children’s participation in after-school activities. With re- 
gard to family relations, both Full MFIP and MFIP Incentives Only increased marriage among 
single-parent long-term welfare recipients, and marriage may have positive effects on children’s 
well-being. However, neither SSP nor New Hope produced similar effects on marriage rates. 8 
Single-parent long-term welfare recipients in both the Full MFIP and MFIP Incentives Only pro- 
grams were also less likely to report experiencing domestic abuse, an outcome that was not 
measured in New Hope or SSP. In some studies, there were also improvements in parents’ emo- 
tional well-being: MFIP Incentives Only reduced parental depression among long-term welfare 
recipients, and New Hope reduced parental stress and increased parents’ feelings of hope. But 
parents in New Hope also reported feeling more time pressure, and, surprisingly, SSP increased 
depression. In terms of parenting behavior, the programs had very few effects on the quality of 
parents’ interactions with their children, one of the key ways in which increases in employment 
and income are expected to affect children. 

All these findings illustrate how difficult it is to conclusively attribute the programs’ ef- 
fects on children to one mechanism. None of the outcomes considered to be possible mediators 
of effects on children was affected across all programs, at least according to the measures exam- 
ined. All four programs have in common one program feature (a generous earnings supplement) 
and one result (an increase in employment and income), but the way in which these factors may 
have affected children remains unclear. 

V. How Did Children and Families in the Program Groups Fare? 

Effect size and impact analyses tell us nothing about how the children and families in 
earnings supplement programs fared — only how the program and control groups fared relative 
to one another. To get a sense of the absolute level of functioning in the families that experienced 
the programs, in this section we examine program group outcomes rather than effect sizes or im- 
pacts — specifically, how program group members fared according to several indicators of well- 
being for families, parents, and children. 

Table 2.1 presents the outcome levels for single-parent families in the program groups 
who, at the time these measures were assessed, were already eligible for the earnings supplement 
and who had, on average, experienced more favorable outcomes than their counterparts in the 
control groups. Because some measures were available for more than one study, for each meas- 
ure a range of outcome levels is presented. As indicated in the table, two-thirds to three-quarters 
of parents in the program groups had incomes from earnings and benefits that put them below the 



7 Zaslow, Oldham, Moore, and Magenheim, 1998; Zaslow, McGroder, Moore, and LeMenestrel, 1999. 

8 In one province, SSP increased marriage rates; in the other province, it reduced marriage rates. New Hope had 
no effects on marriage rates. 
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How Welfare and Work Policies Affect .Children 
Table 2.1 

Program Group Outcomes for Earnings Supplement Programs 



Outcome 


Average 
Level in 
Program 
GrounfsL % 


Number of 
Studies 
Outcome Was 
Measured 


Program 
Improved 
Outcomes on 
This Measure 8 


Material hardship 


Parent has income below poverty 


69-73 


2 


✓ 


Any child skipped meal due to lack of money for food 


5-6 


2 




Health insurance coverage 


Child with continuous health insurance coverage over 3 years 


76-79 


2 


✓ 


Neighborhood quality 


Lives in a safe neighborhood 


73-76 


2 




Parents' well-being 


Parent at risk of clinical depression 


23 -49 


3 


✓ 


Parent stressed much or all of the time 


49 


1 




Parent physically abused by partner last year 


22 


2 


✓ 


Children's well-being 


Child repeated grade since random assignment 


4-14 


3 




Child received special education since random assignment 


14-21 


3 




Child with high behavioral or emotional problems 


7-11 


2 


✓ 


Child at or below 25th percentile on language skills 


38 


1 


✓ 


Child with long-term health problems 


32 


1 


✓ 


Child in very good or excellent health 


oo 

o 


2 





NOTES: In each study, children were selected for inclusion in the sample on the basis of their age at random assignment or their 
age at follow-up. The programs with earnings supplements are the four programs in the MFIP, SSP, and New Hope evaluations. 

The MFIP sample includes children (of parents in the MFIP evaluation) aged 5-12 at the time of the three-year follow- 
up survey (aged approximately 2-9 at the time of random assignment) whose parents were long-term recipients in urban counties 
and underwent random assignment between April 1, 1994, and October31, 1994 (sample size for Full MFIP = 587; for MFIP 
Incentives Only = 573). 

The SSP sample includes children (of parents in the SSP evaluation) aged 6-1 1 at the time of the three-year survey 
(aged approximately 3-8 at random assignment) who were living in the home at the time of random assignment and at the time of 
the three-year follow-up survey (sample size = 2,158). 

The New Hope sample includes children aged 1-10 at random assignment of the single-parent members of the New 
Hope evaluation who participated in the two-year follow-up survey (sample size = 832). 

A check mark signifies that the outcomes on the measure were improved in at least one study. 
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poverty line during the study period, indicating that their incomes were generally very low de- 
spite the increases in income produced by the programs. A very small proportion of program 
group families seemed to be living in extreme deprivation, with 5 percent to 6 percent of parents 
reporting that their children were forced to skip meals because of lack of money for food. Three- 
quarters of parents had children who had continuous health insurance coverage over the previous 
three years, and three-quarters of parents reported living in what they deemed to be safe 
neighborhoods. 

The findings also suggest that these single parents — the great majority of whom were 
mothers — and their children were still at risk of psychological, physical, and cognitive problems 
after being in the programs. According to self-reports collected from parents two or three years 
after random assignment, one-quarter to one-half of parents were at risk of clinical depression, 
one-half felt stressed much or all of the time, and one-fifth had been physically abused by a part- 
ner in the previous year. As for their children, since random assignment around 10 percent had 
repeated a grade, about one-fifth had received special education, and about 1 0 percent had a high 
level of behavioral or emotional problems. More than one-third of children scored at or below the 
25 th percentile on a nationally standardized test of language skills. A comparable proportion of 
children had long-term health problems, although most parents reported that their children were 
in very good or excellent health. 

• Despite the benefits to families of the earnings supplements, many chil- 
dren and families in such programs remained at risk. 

Even after improvements resulting from the programs are taken into account, many chil- 
dren with parents in the earnings supplement programs were still struggling, as were their par- 
ents. While the positive effects on children were measurable and consistent across studies, they 
clearly do not obviate the need for other interventions targeted at low-income children. 



VI. Effects on Long-Term Welfare Recipients 

Much of the impetus behind welfare reform arose from concern about long-term welfare 
recipients, families who were using welfare not as a temporary safety net but for long periods of 
time. In the current welfare climate, parents in these families face the greatest barriers to em- 
ployment because they are least likely to have the skills to move from welfare to employment. 
They are also most likely to be affected by welfare time limits. As caseloads decline, these fami- 
lies are most likely to remain on the rolls. 

• The positive effects of earnings supplements on employment and income 
are larger for long-term welfare recipients than for recipients with a 
shorter welfare history. 

Short-term welfare recipients are more likely than long-term recipients both to have a job 
history and work skills and to work in the absence of a welfare-to-work program. Therefore, the 
differences between program and control groups are generally smaller among short-term recipi- 
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ents than among their long-term counterparts in programs like MFIP. 9 ’ 10 As discussed in detail 
below, the average increase in income is also larger among long-term welfare recipients; it is 
therefore likely that effects on children are most pronounced in these families as well. 

In the figures presented earlier in this chapter, data on children in the MFIP Incentives 
Only and Full MFIP programs are presented for families who had received welfare for two years 
or more. In the Appendix, we compare the effects of the two MFIP programs with those of SSP" 
and New Hope for this same subgroup of families to see whether the cross-program consistency 
of the findings in the child samples examined earlier held in the long-term recipient subgroups 
(see Appendix Table 2). For this subgroup, both Full MFIP and MFIP Incentives Only raised 
parents’ ratings of children’s school achievement. Similarly, New Hope increased both parents’ 
and teachers’ ratings of children’s achievement for long-term recipients. (Note that these New 
Hope effects are even larger than those reported above for the child sample examined earlier, 
which included the children of all low-income single parents.) SSP had positive effects on par- 
ents’ ratings of children’s school achievement for parents with two or more years of welfare re- 
ceipt, as the program did for families with a year or more of welfare receipt (as presented earlier 
in this monograph). 

There is a similar pattern of positive effects for children’s behavior problems, although 
here the effects are smaller and less consistent across studies (see Appendix Table 2). Reductions 
in behavior problems were found among long-term welfare recipients, but only for Full MFIP 
and MFIP Incentives Only. The patterns in New Hope are similar but not statistically significant, 
and no such effects were found in SSP. A similar pattern of effects, with two programs (in this 
case, MFIP Incentives Only and New Hope) producing favorable effects, was observed for chil- 
dren’s positive behavior. 

While the programs were more successful in improving outcomes for children of long- 
term than short-term recipients, children in control group families with long-term welfare receipt 
fared worse than children in control group families with a shorter welfare history (often called 
recent applicants). For example, on average, children in recent applicant families were rated 
higher on positive behavior and lower on behavior problems. 12 Children in recent applicant fami- 
lies were also about half as likely to be performing below average in school and about half as 
likely to be suspended or expelled as their peers in long-term recipient families. Given that par- 
ents in long-term recipient families face greater employment barriers and have fewer job skills, it 
is not surprising that their children also face greater difficulties. 



9 Berlin, 2000; Knox et al., 2000. 

l0 Notably, not all earnings supplement programs are less effective at increasing employment and income among 
people with a shorter history of welfare receipt. For example, a companion to the SSP study examined in this mono- 
graph (for which data on children have not yet been analyzed) tested the effect of offering the SSP earnings supple- 
ment to welfare applicants, but only after they had been on welfare for at least one year during the study period. The 
one-year waiting period boosted the program’s effectiveness by reducing the number of applicants receiving the sup- 
plement who would have started working even without the supplement (Berlin, 2000). 

"The SSP sample consisted of single parents who had been on welfare during 1 1 of the previous 12 months. In 
this analysis, single parents who had been on welfare for at least two years were treated as long-term welfare recipi- 
ents to make the sample more comparable to that in the MFIP study. 

l2 Gennetian and Miller, 2000. 
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• The positive impacts of programs with earnings supplements on children 
are particularly pronounced among long-term welfare recipients. 

In part, the larger child impacts in families with long-term welfare receipt may be a result 
of the programs’ larger effects on long-term recipients’ income and employment. As a result of 
these positive impacts, program group children in this subgroup perform at a level near that of 
control group children in families that had received welfare for less than two years. In other 
words, the earnings supplement programs increased these children’s average outcomes to the 
level of the highest-functioning children in these low-income samples. 

VII. Differences Between Preschool-Aged and Early School-Aged Children 

In light of the research on the effects of child care and income on children reviewed ear- 
lier in this chapter, which indicated that the association between family income and school 
achievement is stronger for younger than for older children and that child care environments have 
important effects on younger children’s functioning, one might expect the impact of earnings 
supplement programs on achievement to be stronger and more positive for preschool-aged chil- 
dren than for children in middle childhood, although it is less clear what the age differences in 
impacts on social behavior, if any, might be. In this section, we examine the effects of earnings 
supplement programs separately on the basis of children’s age when parents first enrolled in the 
study, comparing impacts for children who were 3-5 years old with those for children who were 
6-9 years old. Assessments of the children were collected two to three years after parents’ ran- 
dom assignment. 

In general, the programs that included earnings supplements had positive impacts on chil- 
dren in both age groups; however, some interesting patterns of effects on children’s social behav- 
ior were observed. The impacts on achievement did not consistently favor younger or older chil- 
dren (see Figure 2.6). The impacts of SSP were larger for younger than for older children. The 
pattern of impacts in the New Hope study depended on whether parents or teachers assessed the 
child. Finally, the impacts of the two MFIP programs were stronger for the older than the 
younger children. However, none of these subgroup differences were statistically significant. 

The programs’ effects on social behavior show more pronounced age differences, but 
these differences were not statistically significant (see Figure 2.7). The impacts were generally 
larger for older than for younger children, with the older children more often showing positive 
impacts on social behavior (reductions in behavior problems). This finding is reinforced by our 
analyses of positive as well as negative aspects of children’s behavior (not shown in figures). 
Again, none of these differences for younger and older children were statistically significant. 

VIII. Differences Between Bovs and Girls 

Separate analyses of the effects of earnings supplement programs on girls’ and boys’ 
school achievement revealed no large gender differences (see Figure 2.8). Only in the case of 
MFIP Incentives Only did the impacts differ by gender, and those impacts were more pronounced 
for girls than for boys. In SSP, the impacts were positive for both boys and girls. The impacts on 
children’s test scores in New Hope and on parents’ ratings of achievement in both New Hope and 
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Figure 2.7 

Earnings Supplement Programs Decreased Behavior Problems Somewhat More for Children 
Who Were Older Than for Children Who Were Younger at Random Assignment 
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How Welfare and Work Policies Affect Children 
Figure 2.8 

The Effects on School Achievement Did Not Differ for Boys and Girls 
Consistently Across Earnings Supplement Programs 
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Full MFIP were larger for boys than for girls (although the differences between the subgroup im- 
pacts were not statistically significant in any of the latter three programs). 

As for children’s behavior outcomes, two of the earnings supplement programs had a 
more favorable impact on girls’ behavior than on boys’, while one program had no effect for ei- 
ther boys or girls and one had favorable effects for boys but unfavorable effects for girls (see 
Figure 2.9). In the two MFIP programs there were reductions in behavior problems for girls but 
not for boys (although only in MFIP Incentives Only was the difference between impacts statisti- 
cally significant). SSP had no effect on behavior problems for boys or girls. New Hope had more 
favorable impacts on behavior problems for boys than for girls (see Figure 2.9). In fact, the pro- 
gram’s impacts on girls’ behavior problems were unfavorable: Teachers rated girls in the pro- 
gram group as having more behavior problems than girls in the control group. Finally, the effects 
on positive behavior are also inconsistent across programs. For instance, whereas MFIP Incen- 
tives Only had positive effects for girls but not for boys, New Hope had positive effects for boys 
but not for girls (not shown in figures). 

In sum, some of the programs with earnings supplements had effects primarily on girls, 
while others had effects primarily on boys. With one exception, all these effects were either fa- 
vorable or neutral. There is no clear pattern across programs suggesting that one gender is fa- 
vored over the other. 

IX. Summary and Discussion of the Effects of Programs 
with Earnings Supplements 

These findings suggest that programs with earnings supplements lead to small to modest 
improvements in child outcomes, particularly for children in long-term recipient families. The 
feature that these programs share is the offer of a generous earnings supplement; their differences 
in case management, employment services, in-kind benefits, and whether they provide earnings 
supplements within or outside the welfare system do not appear to result in differences between 
these programs in their impacts on children. Moreover, the results appear to hold across a diverse 
set of sites, samples, and macroeconomic conditions. 

Can these findings be generalized to other programs that include earnings supplements? 
The earnings supplements offered by the programs examined in this chapter were generous, but 
not more so than those offered by a number of programs currently in effect. 

As discussed in greater detail in the companion monograph 13 focusing on the impacts of 
welfare and employment policies on parental employment and income, a typical program group 
member in the MFIP study who worked 20 hours per week at $6 an hour took home about $250 
more in monthly income than she would have under the old welfare rules (which applied to the 
control group). If she worked 40 hours per week, however, her monthly income would have been 
only about $150 higher than it would have been under the old rules. In SSP, in contrast, a typical 
program group member working 20 hours per week at $6 an hour who received the earnings sup- 
plement did not receive any more income than a typical control group member who worked the 



l3 Bloom and Michalopoulos, 2001. 
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Figure 2.9 

The Effects on Behavior Problems Did Not Differ for Boys and Girls 
Consistently Across Earnings Supplement Programs 
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same amount; if the program group member worked 40 hours per week at the same wage, how- 
ever, she received nearly $400 more per month than the control group member. 

How do these supplements compare with those provided by programs now in effect? The 
federal Earned Income Credit (EIC) currently provides nearly $4,000 per year to a parent with 
two children who works full time at a minimum-wage job. In addition, most states have imple- 
mented an “enhanced earnings disregard” as part of their welfare reform strategy, as did the 
MFIP programs. In a number of states, the enhanced earnings disregards are as generous as the 
supplements examined here, or more so. A welfare recipient in Connecticut, for instance, can 
now continue receiving all her welfare and Food Stamp benefits as long as she earns less than the 
federal poverty threshold. Relative to how she would have fared under the AFDC system, this 
disregard provides her with about $600 more per month in income if she works full time at a 
minimum- wage job. And California now allows welfare recipients who work to keep the first 
$225 of their monthly earnings without having their welfare benefits reduced; beyond that point, 
each additional dollar of earnings reduces their benefits by only half a dollar (rather than reduc- 
ing benefits by about a dollar for every dollar of earnings as under AFDC). As a result, a working 
welfare recipient in California can receive as much of an income boost as a program group mem- 
ber who received the maximum benefits in these studies. The situation is similar in other high- 
grant states that have expanded their earnings disregards. 

At the same time, not all enhanced disregards are as generous as the supplements pro- 
vided by the programs analyzed in this chapter. In some states, the disregard is very low, some- 
times as low as 20 percent of a recipient’s earnings (in Nebraska, for example). Also, in states 
with very low benefit levels, even an enhanced earnings disregard translates into little increase in 
family income. For example, in Connecticut, where the maximum benefit for a family of three is 
over $500, 100 percent of income from earnings is disregarded in calculating the grant level. In 
North Carolina, the earnings disregard in the first three months of employment is the same as in 
Connecticut, but the corresponding welfare grant is half as large. Therefore, the boost in income 
from remaining on welfare while working is much smaller in North Carolina than in Connecticut. 

The findings in this monograph suggest that make-work-pay strategies benefit children. 
But it is unclear whether programs that provide less generous earnings supplements will have the 
same benefits for children as the earnings supplement programs examined here. 
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Chapter 3 



Effects on Children of Programs with Mandatory 
Employment Services 

Mandatory employment services are intended to increase employment by requiring par- 
ents to participate in employment, employment-related activities, or education as a condition of 
receiving welfare benefits. On the one hand, mandatory employment services may increase pa- 
rental stress — particularly when parents feel coerced to participate — and thereby affect chil- 
dren adversely. A large body of data indicates that maternal employment is associated with fewer 
positive and more negative outcomes for children when mothers believe that it is inconsistent 
with their roles as parents. 1 Moreover, parents who fail to participate in mandatory programs may 
be faced with a partial or complete loss of welfare benefits, which may increase stress by reduc- 
ing family income. On the other hand, because such programs may increase employment and re- 
duce welfare receipt, they may improve parents’ sense of competence and well-being, which 
could result in positive outcomes for children. In Chapter 2, we found that adding a participation 
mandate did not diminish the positive effects on children of an earnings supplement program. In 
this chapter, we focus on the effects of the six out of the 1 1 programs in this monograph that pro- 
vided mandatory employment services without earnings supplements; all six programs were stud- 
ied in the NEWWS evaluation. 2 

Each of the six programs took one of two basic approaches to providing mandatory em- 
ployment services: a job-search-first approach or an education-first approach. In the job-search- 
first approach, welfare recipients were required to begin by looking for work, either on their own 
or through group activities that teach job-seeking skills (such as job clubs). In the education-first 
approach, most participants were assigned initially to classroom-based education or training ser- 
vices. For participants who had not completed high school, these classes took the form of basic 
education programs offering remedial English or math instruction or preparation for the General 
Educational Development (GED) exam. For high school graduates, these classes took the form of 
vocational educational programs. Notably, the education provided in these programs was gener- 
ally not at an advanced or college level but was instead basic educational instruction that was 
generally available in the community. Therefore, the results cannot tell us how children are af- 
fected by programs that provide parents with higher-level education. 

I. Effects on Parents’ Economic Outcomes 

• The programs with mandatory employment services generally increased 
employment. 

The impacts on employment of the programs that provided mandatory employment services 
(without earnings supplements) are comparable to those of the earnings supplement programs dis- 



1 Alvarez, 1985; Farel, 1980. 

2 This chapter is based on a reanalysis of the data from the NEWWS Child Outcomes Study (McGroder et al., 2000). 
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cussed in Chapter 2. 3 For families with young children (the sample analyzed here), five of the six 
programs increased employment. 4 Because the education-first programs initially placed parents in 
adult basic education, their impacts on employment in the first year were generally smaller than 
those of job-search-first programs. This difference seems to, have disappeared by the third year, al- 
though it nevertheless resulted in larger average increases in earnings for the job-search- first pro- 
grams compared with the education-first programs over the evaluation period as a whole. 5 

• In addition to increasing employment, mandatory employment services 
are intended to reduce welfare receipt, and the programs with mandates 
examined here did so. However, the programs generally left income un- 
changed. 

The effects of the programs with mandatory employment services on welfare receipt gen- 
erally mirror their effects on employment: Those that had the largest effects on employment re- 
duced welfare receipt the most. 6 Four of the six programs examined here decreased welfare re- 
ceipt among families with young children. 7 Because parents are in essence trading their welfare 
benefits for earnings, however, families in these programs were left with no more income on av- 
erage than families in the control group, who were more likely to be receiving welfare. 

• Unlike the programs with earnings supplements, the programs that pro- 
vided only mandatory employment services cost little and sometimes 
saved the government money. 

The average net cost over two years of the six programs with mandatory employment ser- 
vices ranged from a savings of $1,678 per family to a cost of $2,968 per family, lower than the 
average net cost of the programs with earnings supplements. Because of the welfare savings gen- 
erated by these programs, mandatory employment services by themselves increase family earn- 
ings but not family income, and they can sometimes save the government money. 



II. Effects on Children 

• The programs with mandatory employment services generally had no ef- 
fect on young children’s school achievement. 

Figure 3.1 shows the effects on young children’s school achievement of each of the edu- 
cation-first and job-search-first programs in the NEWWS evaluation (see left panel) alongside 
the effects of the programs with earnings supplements discussed in Chapter 2 (see right panel). 
Because all the children in the NEWWS Child Outcomes Study 8 (also the sample of children ex- 
amined here) were 3-5 years old when their parents underwent random assignment, for purposes 
of comparison the results for the earnings supplement programs shown in Figure 3.1 are limited 



3 Bloom and Michalopoulos, 2001. 

4 Hamilton, 2000. 

5 Bloom and Michalopoulos, 2001. 

6 Bloom and Michalopoulos, 2001. 

’Hamilton, 2000. 

8 McGroder et al., 2000. 
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